Bilingual Sign Language Recognition: A YOLOv11-Based Model for Bangla and English Alphabets

Citation

Navin, Nawshin and Farid, Fahmid Al and Rakin, Raiyen Z. and Tanzim, Sadman S. and Rahman, Mashrur and Rahman, Shakila and Uddin, Jia and Abdul Karim, Hezerul (2025) Bilingual Sign Language Recognition: A YOLOv11-Based Model for Bangla and English Alphabets. Journal of Imaging, 11 (5). p. 134. ISSN 2313-433X

[img] Text
Bilingual Sign Language Recognition_ A YOLOv11-Based Model for Bangla and English Alphabets.pdf - Published Version
Restricted to Repository staff only

Download (7MB)

Abstract

Communication through sign language effectively helps both hearing‑ and speaking‑impaired individuals connect. However, there are problems with the interlin‑ gual communication between Bangla Sign Language (BdSL) and English Sign Language (ASL) due to the absence of a unified system. This study aims to introduce a detection system that incorporates these two sign languages to enhance the flow of communication for those who use these forms of sign language. This study developed and tested a deep learning‑based sign‑language detection system that can recognize both BdSL and ASL al‑ phabets concurrently in real time. The approach uses a YOLOv11 object detection architec‑ ture that has been trained with an open‑source dataset on a set of 9556 images containing 64 different letter signs from both languages. Data preprocessing was applied to enhance the performance of the model. Evaluation criteria, including the precision, recall, mAP, and other parameter values were also computed to evaluate the model. The performance analysis of the proposed method shows a precision of 99.12% and average recall rates of 99.63% in 30 epochs. The studies show that the proposed model outperforms the current techniques in sign language recognition (SLR) and can be used in communicating assistive technologies and human–computer interaction systems.

Item Type: Article
Uncontrolled Keywords: Deep learning
Subjects: Q Science > Q Science (General) > Q300-390 Cybernetics
Divisions: Faculty of Engineering (FOE)
Depositing User: Ms Rosnani Abd Wahab
Date Deposited: 26 Jun 2025 07:56
Last Modified: 26 Jun 2025 07:56
URII: http://shdl.mmu.edu.my/id/eprint/14118

Downloads

Downloads per month over past year

View ItemEdit (login required)