Citation

Babaei, Mahdi and Babaei, Hossein Reza and Ng, Kok Why and Parsi, Pooria (2015) A quality framework for multimodal interaction in educational environments. In: 2015 IEEE 3rd International Conference on Smart Instrumentation, Measurement and Applications (ICSIMA). IEEE, pp. 1-6. ISBN 978-1-4673-7255-8

Text 07559001.pdf Restricted to Repository staff only Download (402kB)

Abstract

Designing gesture-based collaborative and interactive systems using new technologies has shown noticeable potential for educational purposes and could enhance the memorability of digital contents. In this paper, we present a quality framework and a new combination of modalities to recognise different types of human gestures. The outcome can be used in future classroom designs by replacing expensive smartboards which are physically limited to a fixed place. We also propose a framework based on Norman's theory of action for interactive collaborative systems. This framework has been tested by a combination of Microsoft Kinect and a smartphone's built-in gyroscope together with two types of interfaces in an educational environment. The results proved the improvement of participant's interactivity and participation by changes in five pedagogical factors in different groups of the study and specifically in higher ages.

Item Type:	Book Section
Uncontrolled Keywords:	Pedagogy, Interaction design, Multimodal Interaction, Microsoft Kinect, Mobile Phone
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics
Divisions:	Faculty of Computing and Informatics (FCI) Faculty of Creative Multimedia (FCM)
Depositing User:	Ms Suzilawati Abu Samah
Date Deposited:	08 Dec 2017 14:56
Last Modified:	08 Dec 2017 14:56
URII:	http://shdl.mmu.edu.my/id/eprint/6588

Downloads

Edit (login required)