Citation

Ren Ewe, Edmond Li and Lee, Chin Poo and Lim, Kian Ming and Kwek, Lee Chung and Lim, Heng Siong (2025) LViTE: A Lightweight Vision Transformer with Ensemble Classification for Sign Language Recognition. In: 2025 International Conference on Information and Communication Technology, ICoICT 2025, 30 July 2025 - 31 July 2025, Bandung, Indonesia.

Text 14964.pdf - Published Version Restricted to Repository staff only Download (683kB)

Abstract

Sign language recognition is essential for human-machine interaction, supporting communication for individuals with hearing and speech impairments. However, challenges remain due to variability in hand shapes, orientations, motion dynamics, and environmental factors such as lighting and occlusion. Moreover, many existing models are computationally intensive, limiting their applicability in resource-constrained settings. This paper introduces the Lightweight Vision Transformer with Ensemble Classification (LViTE), a streamlined framework that balances accuracy and efficiency. LViTE employs a reduced Vision Transformer backbone with fewer encoder layers and attention heads to lower computational cost, while an ensemble-based classification mechanism enhances robustness through aggregated predictions from multiple decision trees. Evaluated on three benchmark datasets—American Sign Language (ASL), ASL with Digits, and NUS Hand Posture—LViTE achieves state-of-the-art accuracies of 99.98%, 99.98%, and 99.97%, respectively. These results demonstrate LViTE’s effectiveness and suitability for real-time deployment in human-machine systems where both performance and efficiency are critical.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	Deep learning, human-machine, machine learning, sign language recognition, vision transformer
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Engineering and Technology (FET)
Depositing User:	Nurin Syazwani Azmi
Date Deposited:	04 Dec 2025 08:49
Last Modified:	04 Dec 2025 08:49
URII:	http://shdl.mmu.edu.my/id/eprint/14964

Downloads

Edit (login required)