Spontaneous subtle expression detection and recognition based on facial strain

Citation

Liong, Sze Teng and See, John Su Yang and Phan, Raphael Chung Wei and Oh, Yee Hui and Le Ngo, Anh Cat and Wong, Kok Sheik and Tan, Su Wei (2016) Spontaneous subtle expression detection and recognition based on facial strain. Signal Processing: Image Communication, 47. pp. 170-182. ISSN 0923-5965

[img] Text
1-s2.0-S092359651630090X-main.pdf
Restricted to Repository staff only

Download (1MB)

Abstract

Optical strain is an extension of optical flow that is capable of quantifying subtle changes on faces and representing the minute facial motion intensities at the pixel level. This is computationally essential for the relatively new field of spontaneous micro-expression, where subtle expressions can be technically challenging to pinpoint. In this paper, we present a novel method for detecting and recognizing micro-expressions by utilizing facial optical strain magnitudes to construct optical strain features and optical strain weighted features. The two sets of features are then concatenated to form the resultant feature histogram. Experiments were performed on the CASME II and SMIC databases. We demonstrate on both databases, the usefulness of optical strain information and more importantly, that our best approaches are able to outperform the original baseline results for both detection and recognition tasks. A comparison of the proposed method with other existing spatio-temporal feature extraction approaches is also presented.

Item Type: Article
Uncontrolled Keywords: Subtle expressions; Micro-expressions; Facial strain; Detection; Recognition
Subjects: T Technology > TA Engineering (General). Civil engineering (General)
Divisions: Faculty of Engineering (FOE)
Faculty of Computing and Informatics (FCI)
Depositing User: Ms Suzilawati Abu Samah
Date Deposited: 08 Dec 2017 15:12
Last Modified: 08 Dec 2017 15:12
URII: http://shdl.mmu.edu.my/id/eprint/6590

Downloads

Downloads per month over past year

View ItemEdit (login required)