Citation

Tham, K. Y. and Cheam, T. W. and Wong, Hwee Ling and Ahmad Fauzi, Mohammad Faizal (2020) Development of a Bi-level Web Connected Home Access System using Multi-Deep Learning Neural Networks. In: Computational Science and Technology. Lecture Notes in Electrical Engineering (Computational Science and Technology), 603 . Springer Verlag, pp. 227-236. ISBN 9789811500572

Text 10.1007@978-981-15-0058-9.pdf - Published Version Restricted to Repository staff only Download (46MB)

Abstract

Home entrance is a vital entry point that should be secured at all times. A bi-level home access system was designed and developed using face authentication and hand gesture recognition. The system’s mainframe runs on a Raspberry Pi 3 minicomputer. The board serves as the computing platform to process various deep learning algorithms for face authentication and hand gesture recognition. It also serves as a communication hub which allows registered users to communicate with the system remotely via mobile application. Home occupants may also register emergency contacts such as their neighbours’ for quick response at their property. An Android mobile application was developed for remote user interface. Google Firebase platform was used to store user profile and historical data. The face authentication consists of two steps, namely face detection and face recognition. The Multitask Cascaded Convolutional Neural Network (MTCNN) was employed for face detection, while the Inception ResNet was used for face recognition. Upon successful face authentication, the system proceeds to read the user’s hand gesture. First, the system detects the hand using Single Shot MultiBox Detector (SSD) that runs on a Convolutional Neural Network (CNN). Next, a sequence of hand pose is recognised using the conventional CNN method. Based on experiments, the average detection/recognition accuracy under normal operating conditions using real face and realvideo captured by the system is approximately 95.7%. An occupant needs approximately 7s to complete the process to enter the house.

Item Type:	Book Section
Uncontrolled Keywords:	Neural networks (Computer science), Face Authentication, Hand Gesture Recognition, Deep Learning, Embedded System, Raspberry Pi, Android Mobile Apps, Google Firebase
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Engineering (FOE)
Depositing User:	Ms Suzilawati Abu Samah
Date Deposited:	16 Dec 2020 11:53
Last Modified:	16 Dec 2020 11:53
URII:	http://shdl.mmu.edu.my/id/eprint/7953

Downloads

Edit (login required)