Multimodal decomposition for enhanced subtle emotion recognition


Lee, Zun Ci and Phan, Raphael and Tan, Su Wei and Lee, Kuan Heng (2017) Multimodal decomposition for enhanced subtle emotion recognition. In: 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 12-15 Dec. 2017, Kuala Lumpur, Malaysia.

[img] Text
67.pdf - Published Version
Restricted to Repository staff only

Download (2MB)


True human emotions may be revealed during brief moments of minute facial muscle movements. These so-called subtle emotions are low in intensity, sparse and short duration in nature. Despite such tiny presence, subtle emotions have shown to be useful for real-life applications including lie detection and clinical diagnosis. In this paper, we present a processing technique based on multimodal decomposition and emotion magnification that is viable to decompose and subsequently emphasize highly discriminative subtle emotions information. Through this method, promising results of 25-30% improvement in recognition performance are achieved. By further magnifying the decomposed emotion components, the subtle emotions intensity can be increased and further boost recognition performance by 3-4%.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Intensity
Subjects: Q Science > QE Geology
Divisions: Faculty of Engineering (FOE)
Depositing User: Ms Rosnani Abd Wahab
Date Deposited: 26 Apr 2021 14:53
Last Modified: 26 Apr 2021 14:53


Downloads per month over past year

View ItemEdit (login required)