Usability and user experience in touchless hand gesture interfaces with mapping


Shanmugam, Mohana (2023) Usability and user experience in touchless hand gesture interfaces with mapping. PhD thesis, Multimedia University.

Full text not available from this repository.
Official URL:


This thesis studies the mapping concepts in design of touchless hand gesture (THG) interfaces to improve its usability and user experience (UX). Literature review is on touchless interaction, human computer interaction’s principles on user-centred design, feedback and affordance, methods to measure UX and usability, touchless hand gesture interaction styles, gesture tasks and classifications and types of mappings. This study uses two applications by Leap Inc. that use mappings to explore how and why these applications affect UX and usability. The target population for the study consist of university students undertaking computing programme and have studied a subject called Human Computer Interaction (HCI). Even though, these target population is IT savvy, they have very limited exposure to touchless interaction, if any. This study has three phases with the first phase collecting design ideas from focus group studies with 91 participants and USE-Lite survey with 66 respondents. Using survey, perceived usability on the chosen applications is gathered. In phase two, interviews are conducted to gather information on why or how a certain design affects the user. Apart from that, the author also conducts a heuristics evaluation on the selected applications in this study. The analysis of interview is completed with Atlas.ti 8 software. For phase 3, usability testing and GOMS analysis is conducted. The results show conventional mapping is preferred by users, as it is something that is learnt over time. However, this is only true if the interface is useful and relevant. Otherwise, if an alternative option is available to give input (e.g., mouse or keyboard), the interface using THG is not considered to be useful. To improve the usability, additional isomorphic mapping is able to reduce the number of steps needed to complete a task and ultimately UX is supported since there is intuitiveness and controllability.

Item Type: Thesis (PhD)
Additional Information: Call No.: QA76.9.H85 .M64 2023
Uncontrolled Keywords: Human-computer interaction
Subjects: Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions: Faculty of Creative Multimedia (FCM)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 07 Feb 2024 07:28
Last Modified: 07 Feb 2024 07:28


Downloads per month over past year

View ItemEdit (login required)