Citation
Lee, Gin Chong and Loo, Chu Kiong and Liew, Wei Shiung (2022) Self-Organizing Reservoir Network for Action Recognition. Malaysian Journal of Computer Science (MJCS), 35 (3). pp. 243-263. ISSN 0127-9084
Text
20.pdf - Published Version Restricted to Repository staff only Download (1MB) |
Abstract
Current research in human action recognition (HAR) focuses on efficient and effective modelling of the temporal features of human actions in 3-dimensional space. Echo State Networks (ESNs) are one suitable method for encoding the temporal context due to its short-term memory property. However, the random initialization of the ESN's input and reservoir weights may increase instability and variance in generalization. Inspired by the notion that input-dependent self-organization is decisive for the cortex to adjust the neurons according to the distribution of the inputs, a Self-Organizing Reservoir Network (SORN) is developed based on Adaptive Resonance Theory (ART) and Instantaneous Topological Mapping (ITM) as the clustering process to cater deterministic initialization of the ESN reservoirs in a Convolutional Echo State Network (ConvESN) and yield a Self-Organizing Convolutional Echo State Network (SO-ConvESN). SORN ensures that the activation of ESN’s internal echo state representations reflects similar topological qualities of the input signal which should yield a self-organizing reservoir. In the context of HAR task, human actions encoded as a multivariate time series signals are clustered into clustered node centroids and interconnectivity matrices by SORN for initializing the SO-ConvESN reservoirs. By using several publicly available 3D-skeleton-based action recognition datasets, the impact of vigilance threshold and reservoir perturbation of SORN in performing clustering, the SORN reservoir dynamics and the capability of SO-ConvESN on HAR task have been empirically evaluated and analyzed to produce competitive experimental results.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Echo State Networks, Action Recognition, Self-Organizing Networks, Deep Neural Networks |
Subjects: | Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science |
Divisions: | Faculty of Engineering and Technology (FET) |
Depositing User: | Ms Nurul Iqtiani Ahmad |
Date Deposited: | 14 Sep 2022 01:33 |
Last Modified: | 14 Sep 2022 01:33 |
URII: | http://shdl.mmu.edu.my/id/eprint/10436 |
Downloads
Downloads per month over past year
Edit (login required) |