Citation

Lee, Gin Chong and Loo, Chu Kiong and Liew, Wei Shiung (2022) Self-Organizing Reservoir Network for Action Recognition. Malaysian Journal of Computer Science (MJCS), 35 (3). pp. 243-263. ISSN 0127-9084

Text 20.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

Current research in human action recognition (HAR) focuses on efficient and effective modelling of the temporal features of human actions in 3-dimensional space. Echo State Networks (ESNs) are one suitable method for encoding the temporal context due to its short-term memory property. However, the random initialization of the ESN's input and reservoir weights may increase instability and variance in generalization. Inspired by the notion that input-dependent self-organization is decisive for the cortex to adjust the neurons according to the distribution of the inputs, a Self-Organizing Reservoir Network (SORN) is developed based on Adaptive Resonance Theory (ART) and Instantaneous Topological Mapping (ITM) as the clustering process to cater deterministic initialization of the ESN reservoirs in a Convolutional Echo State Network (ConvESN) and yield a Self-Organizing Convolutional Echo State Network (SO-ConvESN). SORN ensures that the activation of ESN’s internal echo state representations reflects similar topological qualities of the input signal which should yield a self-organizing reservoir. In the context of HAR task, human actions encoded as a multivariate time series signals are clustered into clustered node centroids and interconnectivity matrices by SORN for initializing the SO-ConvESN reservoirs. By using several publicly available 3D-skeleton-based action recognition datasets, the impact of vigilance threshold and reservoir perturbation of SORN in performing clustering, the SORN reservoir dynamics and the capability of SO-ConvESN on HAR task have been empirically evaluated and analyzed to produce competitive experimental results.

Item Type:	Article
Uncontrolled Keywords:	Echo State Networks, Action Recognition, Self-Organizing Networks, Deep Neural Networks
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Engineering and Technology (FET)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	14 Sep 2022 01:33
Last Modified:	14 Sep 2022 01:33
URII:	http://shdl.mmu.edu.my/id/eprint/10436

Downloads

Edit (login required)