Citation

Yu, Jing Xuan and Lim, Kian Ming and Lee, Chin Poo (2021) MoVE-CNNs: Model aVeraging Ensemble of Convolutional Neural Networks for Facial Expression Recognition. IAENG International Journal of Computer Science, 48 (3). pp. 1-5. ISSN 1819-9224

Text MoVE CNNs Model aVeraging Ensemble of Convolutional Neural....pdf Restricted to Repository staff only Download (1MB)

Abstract

Facial expression is a powerful non-verbal communication that can express emotions and messages without saying a single word. In view of the prominence of facial expression, we propose a model averaging ensemble of Convolutional Neural Networks (CNN) that consolidates multiple pre-trained CNN models. Each pre-trained CNN model first undergoes transfer learning with the classification layer substituted with a multilayer perceptron. The newly formed model is then fine-tuned on the facial expression datasets and adapted to facial expression recognition. The predictions returned by all models are combined by model averaging to determine the final class probability distributions. The proposed model averaging ensemble of CNNs is evaluated on three facial expression datasets: FER-2013, modified CK+ and RAF-DB. Since the modified CK+ dataset is a small dataset, data augmentation is leveraged to increase the size and diversity of data. Apart from that, oversampling is adopted to address the class imbalance challenge in RAF-DB. The empirical results demonstrate that the proposed model averaging ensemble of CNNs outperforms the individual ensemble model at the test accuracy of 77.70%, 94.10% and 87.50% in FER 2013, modified CK+ and RAF-DB datasets, respectively.

Item Type:	Article
Uncontrolled Keywords:	Human face recognition (Computer science), Facial expression, facial expression recognition, convolutional neural network, ensemble, model averaging, transfer learning, data augmentation, oversampling
Subjects:	T Technology > TA Engineering (General). Civil engineering (General) > TA1501-1820 Applied optics. Photonics
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	03 Nov 2021 13:23
Last Modified:	03 Nov 2021 13:23
URII:	http://shdl.mmu.edu.my/id/eprint/9573

Downloads

Edit (login required)