Citation

Le Ngo, Anh Cat and See, John Su Yang and Phan, Raphael Chung Wei (2017) Sparsity in Dynamics of Spontaneous Subtle Emotions: Analysis and Application. IEEE Transactions on Affective Computing, 8 (3). pp. 396-411. ISSN 1949-3045

Text 07397931.pdf Restricted to Repository staff only Download (1MB)

Abstract

Subtle emotions are present in diverse real-life situations: in hostile environments, enemies and/or spies maliciouslyconceal their emotions as part of their deception; in life-threatening situations, victims under duress have no choice but to withhold theirreal feelings; in the medical scene, patients with psychological conditions such as depression could either be intentionally orsubconsciously suppressing their anguish from loved ones. Under such circumstances, it is often crucial that these subtle emotions arerecognized before it is too late. These spontaneous subtle emotions are typically expressed through micro-expressions, which are tiny,sudden and short-lived dynamics of facial muscles; thus, such micro-expressions pose a great challenge for visual recognition. Theabrupt but significant dynamics for the recognition task are temporally sparse while the rest, i.e. irrelevant dynamics, are temporallyredundant. In this work, we analyze and enforce sparsity constraints to learn significant temporal and spectral structures whileeliminating irrelevant facial dynamics of micro-expressions, which would ease the challenge in the visual recognition of spontaneoussubtle emotions. The hypothesis is confirmed through experimental results of automatic spontaneous subtle emotion recognition withseveral sparsity levels on CASME II and SMIC, the two well-established and publicly available spontaneous subtle emotion databases.The overall performances of the automatic subtle emotion recognition are boosted when only significant dynamics of the originalsequences are preserved.

Item Type:	Article
Uncontrolled Keywords:	Dynamics—Computer programs
Subjects:	Q Science > QA Mathematics > QA801-939 Analytic mechanics
Divisions:	Faculty of Engineering (FOE)
Depositing User:	Ms Suzilawati Abu Samah
Date Deposited:	21 Oct 2020 14:57
Last Modified:	21 Oct 2020 14:57
URII:	http://shdl.mmu.edu.my/id/eprint/7047

Downloads

Edit (login required)