Efficient American Sign Language Recognition Using Resnet-50

Citation

Sharifuzzaman, Md and Sen, Anik and Ghosh, Joyashish and Liew, Tze Hui and Purkaystha, Debanjon Dutta and Ghose, Saptanil and Pervez, Masud and Hossen, Md. Jakir (2025) Efficient American Sign Language Recognition Using Resnet-50. In: 11th International Conference on Engineering, Applied Sciences, and Technology, ICEAST 2025, 6 -9 May 2025, Phuket, Thailand.

[img] Text
Efficient American Sign Language Recognition Using Resnet-50.pdf - Published Version
Restricted to Repository staff only

Download (3MB)

Abstract

This study presents a robust and efficient American Sign Language (ASL) recognition system utilizing the ResNet50 architecture with transfer learning. The system is designed to accurately classify 26 static ASL alphabet gestures while tackling challenges such as hand shape variations, varying lighting conditions, and a limited dataset size. To enhance performance and reduce overfitting, data augmentation methods including rotation and horizontal flipping were applied. By leveraging transfer learning from a pre-trained ResNet-50 model, the proposed approach benefits from shorter training times and reduced computational demands without compromising accuracy. Experimental results show the system achieves an overall accuracy of 98.34 %, along with balanced precision, recall, and F1-scores across all gesture classes. Additionally, early stopping mechanisms were implemented to prevent overfitting and ensure generalization to unseen data. This work contributes to the advancement of deep learning-based models for ASL recognition and supports the development of inclusive communication technologies that foster seamless interaction between hearing and non-hearing communities.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Data augmentation, deep learning
Subjects: Q Science > Q Science (General) > Q300-390 Cybernetics
Divisions: Faculty of Engineering and Technology (FET)
Faculty of Information Science and Technology (FIST)
Depositing User: Ms Rosnani Abd Wahab
Date Deposited: 27 Aug 2025 03:52
Last Modified: 29 Aug 2025 10:04
URII: http://shdl.mmu.edu.my/id/eprint/14434

Downloads

Downloads per month over past year

View ItemEdit (login required)