Citation

Lim, Kian Ming and Tan, Alan Wee Chiat and Tan, Shing Chiang (2016) Block-based histogram of optical flow for isolated sign language recognition. Journal of Visual Communication and Image Representation, 40 (B). pp. 538-545. ISSN 1047-3203

Text 1-s2.0-S1047320316301468-main.pdf Restricted to Repository staff only Download (1MB)

Abstract

In this paper, we propose a block-based histogram of optical flow (BHOF) to generate hand representation in sign language recognition. Optical flow of the sign language video is computed in a region centered around the location of the detected hand position. The hand patches of optical flow are segmented into M spatial blocks, where each block is a cuboid of a segment of a frame across the entire sign gesture video. The histogram of each block is then computed and normalized by its sum. The feature vector of all blocks are then concatenated as the BHOF sign gesture representation. The proposed method provides a compact scale-invariant representation of the sign language. Furthermore, block-based histogram encodes spatial information and provides local translation invariance in the extracted optical flow. Additionally, the proposed BHOF also introduces sign language length invariancy into its representation, and thereby, produce promising recognition rate in signer independent problems.

Item Type:	Article
Uncontrolled Keywords:	Sign language recognition, Block-based, Histogram of optical flow
Subjects:	T Technology > TA Engineering (General). Civil engineering (General) > TA1501-1820 Applied optics. Photonics
Divisions:	Faculty of Information Science and Technology (FIST) Faculty of Engineering and Technology (FET)
Depositing User:	Ms Suzilawati Abu Samah
Date Deposited:	13 Dec 2017 16:25
Last Modified:	13 Dec 2017 16:25
URII:	http://shdl.mmu.edu.my/id/eprint/6631

Downloads

Edit (login required)