Citation

Sayed Ismail, Sharifah Noor Masidayu and Ab Aziz, Nor Azlina and Ibrahim, Siti Zainab and Nawawi, Sophan Wahyudi and Alelyani, Salem and Mohana, Mohamed and Lee, Chia Chun (2022) Evaluation of electrocardiogram: numerical vs. image data for emotion recognition system. F1000Research, 10. p. 1114. ISSN 2046-1402

Text c07b6aed-ab63-426e-9dd2-d14be1e129fd_73255_-_sharifah_noor_masidayu_sayed_ismail.pdf Restricted to Repository staff only Download (1MB)

Abstract

The electrocardiogram (ECG) is a physiological signal used to diagnose and monitor cardiovascular disease, usually using 2- D ECG. Numerous studies have proven that ECG can be used to detect human emotions using 1-D ECG; however, ECG is typically captured as 2-D images rather than as 1-D data. There is still no consensus on the effect of the ECG input format on the accuracy of the emotion recognition system (ERS). The ERS using 2-D ECG is still inadequately studied. Therefore, this study compared ERS performance using 1-D and 2-D ECG data to investigate the effect of the ECG input format on the ERS. Methods: This study employed the DREAMER dataset, which contains 23 ECG recordings obtained during audio-visual emotional elicitation. Numerical data was converted to ECG images for the comparison. Numerous approaches were used to obtain ECG features. The Augsburg BioSignal Toolbox (AUBT) and the Toolbox for Emotional feature extraction from Physiological signals (TEAP) extracted features from numerical data. Meanwhile, features were extracted from image data using Oriented FAST and rotated BRIEF (ORB), Scale Invariant Feature Transform (SIFT), KAZE, Accelerated-KAZE (AKAZE), Binary Robust Invariant Scalable Keypoints (BRISK), and Histogram of Oriented Gradients (HOG). Dimension reduction was accomplished using linear discriminant analysis (LDA), and valence and arousal were classified using the Support Vector Machine (SVM). Results: The experimental results show 1-D ECG-based ERS achieved 65.06% of accuracy and 75.63% of F1 score for valence, and 57.83% of accuracy and 44.44% of F1-score for arousal. For 2-D ECG-based ERS, the highest accuracy and F1-score for valence were 62.35% and 49.57%; whereas, the arousal was 59.64% and 59.71%. Conclusions: The results indicate that both inputs work comparably well in classifying emotions, which demonstrates the potential of 1-D and 2-D as input modalities for the ERS.

Item Type:	Article
Uncontrolled Keywords:	Emotion recognition, electrocardiogram, numerical ECG
Subjects:	T Technology > TA Engineering (General). Civil engineering (General) > TA329-348 Engineering mathematics. Engineering analysis
Divisions:	Faculty of Engineering (FOE) Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	01 Aug 2022 01:23
Last Modified:	01 Aug 2022 01:23
URII:	http://shdl.mmu.edu.my/id/eprint/10263

Downloads

Edit (login required)