Citation

Khoh, Wee How (2021) Spatial-Temporal Analysis of In-Air Hand Gesture Signature Recognition. PhD thesis, Multimedia University.

Full text not available from this repository.

Abstract

A traditional online handwritten signature recognition system requires direct contact with the acquisition device that may leave a trace on the device's surface. This results in a signature being easily tracked and imitated. Such an acquisition device is not commonly available, while the public usually shares this device. Germs could be accumulated on the devices, and thus, a hygiene concern has risen. A novel approach in recognising a signature based on hand motion is proposed to address these issues, namely in-air hand gesture signature (iHGS). A low-cost acquisition device – the Microsoft Kinect sensor, is used to capture hand gesture-based signatures. Unlike the conventional dynamic signature, the captured hand gesture-based signature is a sequence of images containing the signing action's spatial and temporal information. To detect and extract the region of interest, a hand region is first located and segmented from a depth image by a predictive hand segmentation algorithm. The resultant volume data is then condensed and transformed into three directional plane projections. Specifically, XY plane projection employs Motion History Image (MHI) to obtain a compact motion representation image, whist XT plane projection (X-profile) and YT plane projection (Y-profile) project the volume data along the x-axis and y-axis, respectively. Vector-based and image-based features are extracted from the transformed image templates. A vector-based feature is a one-dimensional vector produced through the image templates into a vector space that numerically quantifies the local information of an image. An image-based feature is a visual representation feature that combines one or more image templates into a static image that better visualizes a hand gesture signature's spatial and temporal information. In the experimental analysis, classification performance and system robustness are systematically assessed using a self-collected dataset, the iHGS dataset. For the classification analysis, the k-NN and SVM classifiers are employed to classify the vector-based features. A pre-trained deep learning model is used to classify imagebased features. On the other hand, system robustness is also investigated against two common forgery attacks, (1) random forgeries and (2) skilled forgeries. Additionally, performance comparisons are conducted between the proposed methods with several state-of-art approaches. The overall performance analysis has demonstrated the potential and efficiency of the proposed methods in recognising and verifying in-air hand gesture signature recognition.

Item Type:	Thesis (PhD)
Additional Information:	Call No: QA76.9.A25 K46 2021
Uncontrolled Keywords:	Data encryption (Computer science)
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	22 May 2023 04:56
Last Modified:	22 May 2023 04:56
URII:	http://shdl.mmu.edu.my/id/eprint/11417

Downloads

Edit (login required)