Facial emotion recognition based on deep transfer learning approach

Citation

Sultana, Aziza and Dey, Samrat Kumar and Rahman, Md. Armanur (2023) Facial emotion recognition based on deep transfer learning approach. Multimedia Tools and Applications. ISSN 1380-7501

[img] Text
22.pdf - Published Version
Restricted to Repository staff only

Download (1MB)

Abstract

Facial expressions play a major role in the communication of emotions through nonverbal channels. In recent years, the topic of automatic facial expression recognition (FER) has become very popular. Researchers are looking at how it may be used in education, security surveillance, smart healthcare system, and to understand the behavior of a community or a person. As long as there are variations in images, such as diferent poses and lighting, accurate and robust FER remains a challenge using computer models. We developed an approach to automatically classifying facial expressions based on deep transfer learning. The approach was constructed with convolutional neural networks (CNN) and VGG19, which is a transfer learning model. To train the model, we employed contemporary deep learning techniques such as optimal learning rate fnder, fne-tuning, and data augmentation. On both the Extended Cohn-Kanade (CK+) and the Japanese Female Facial Expression (JAFFE) datasets, the proposed model achieved accuracy values of 94.8% and 93.7%, respectively. The developed system has already been tested on a vast database and can be used to assist online education systems, surveillance systems, and smart healthcare systems in their daily activities.

Item Type: Article
Uncontrolled Keywords: Transfer learning · VGG19 · CK+ · JAFFE · Emotion recognition
Subjects: B Philosophy. Psychology. Religion > BF Psychology (General)
Divisions: Faculty of Engineering and Technology (FET)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 02 Jun 2023 01:36
Last Modified: 02 Jun 2023 01:36
URII: http://shdl.mmu.edu.my/id/eprint/11455

Downloads

Downloads per month over past year

View ItemEdit (login required)