Dual-stream Shallow Networks for Facial Micro-expression Recognition


Khor, Huai Qian and See, John Su Yang and Liong, Sze Teng and Phan, Raphael Chung Wei and Lin, Weiyao (2019) Dual-stream Shallow Networks for Facial Micro-expression Recognition. In: 2019 IEEE International Conference on Image Processing (ICIP), 22-25 Sept. 2019, Taipei, Taiwan.

[img] Text
99.pdf - Published Version
Restricted to Repository staff only

Download (1MB)


Micro-expressions are spontaneous, brief and subtle facial muscle movements that exposes underlying emotions. Motivated by recent exploits into deep learning for micro-expression analysis, we propose a lightweight dual-stream shallow network in the form of a pair of truncated CNNs with heterogeneous input features. The merging of the convolutional features allows for discriminative learning of micro-expression classes stemming from both streams. Using activation heatmaps, we further demonstrate that salient facial areas are well emphasized, and correspond closely to relevant action units belonging to emotion classes. We empirically validate the proposed network on three benchmark databases, obtaining state-of-the-art performance on the CASME II and SAMM while remaining competitive on the SMIC. Further observations point towards the sufficiency of utilizing shallower deep networks for micro-expression recognition

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Micro-expression, recognition, apex frame, dual-stream networks, shallow CNN
Subjects: Q Science > Q Science (General) > Q300-390 Cybernetics
Divisions: Faculty of Computing and Informatics (FCI)
Depositing User: Ms Rosnani Abd Wahab
Date Deposited: 27 Oct 2021 04:32
Last Modified: 27 Oct 2021 04:32
URII: http://shdl.mmu.edu.my/id/eprint/8827


Downloads per month over past year

View ItemEdit (login required)