Real-Time Confidence Detection through Facial Expressions and Hand Gestures

Citation

Sakib, Tanjil Hasan and Mojumder, Samia Jahan and Gupta, Rajan Das and Showmick, Md Imrul Hasan and Rahat, Md. Yeasin and Hossen, Md. Jakir (2025) Real-Time Confidence Detection through Facial Expressions and Hand Gestures. In: 2025 Multimedia University Engineering Conference (MECON), 21-23 July 2025, Cyberjaya, Malaysia.

[img] Text
464.pdf - Published Version
Restricted to Repository staff only

Download (1MB)

Abstract

Realtime face orientation recognition is a cutting-edge technology meant to track and analyze facial movements in virtual environments such as online interviews, remote meetings, and virtual classrooms. As the demand for virtual interactions grows, it becomes increasingly important to measure participant engagement, attention, and overall interaction. This research presents a novel solution that leverages the Media Pipe Face Mesh framework to identify facial landmarks and extract geometric data for calculating Euler angles, which determines head orientation in real time. The system tracks 3D facial landmarks and uses this data to compute head movements with a focus on accuracy and responsiveness. By studying Euler angles, the system can identify a user’s head orientation with an accuracy of 90%, even at a distance of up to four feet. This capability offers significant enhancements for monitoring user interaction, allowing for more immersive and interactive virtual experiences. The proposed method shows its reliability in evaluating participant attentiveness during online assessments and meetings. Its application goes beyond engagement analysis, potentially providing a means for improving the quality of virtual communication, fostering better understanding between participants, and ensuring a higher level of interaction in digital spaces. This study offers a basis for future developments in enhancing virtual user experiences by integrating real-time facial tracking technologies, paving the way for more adaptive and interactive web-based platforms.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Facial Positioning, Head Movement Analysis, Pose Estimation, Real- time Face Tracking, Direction Estimation, Motion Detection, Dynamic Facial Tracking
Subjects: Q Science > Q Science (General)
Divisions: Faculty of Engineering and Technology (FET)
Depositing User: Ms Suzilawati Abu Samah
Date Deposited: 19 Mar 2026 00:02
Last Modified: 19 Mar 2026 00:02
URII: http://shdl.mmu.edu.my/id/eprint/15506

Downloads

Downloads per month over past year

View ItemEdit (login required)