Citation

Wang, Tao and Chen, Kean and Lin, Weiyao and See, John Su Yang and Zhang, Zenghui and Xu, Qian and Jia, Xia (2023) Spatio-Temporal Point Process for Multiple Object Tracking. IEEE Transactions on Neural Networks and Learning Systems, 34 (4). pp. 1777-1788. ISSN 2162-237X

Text 3.pdf - Published Version Restricted to Repository staff only Download (4MB)

Abstract

Multiple object tracking (MOT) focuses on modeling the relationship of detected objects among consecutive frames and merge them into different trajectories. MOT remains a challenging task as noisy and confusing detection results often hinder the final performance. Furthermore, most existing research are focusing on improving detection algorithms and association strategies. As such, we propose a novel framework that can effectively predict and mask-out the noisy and confusing detection results before associating the objects into trajectories. In particular, we formulate such “bad” detection results as a sequence of events and adopt the spatio-temporal point process to model such events. Traditionally, the occurrence rate in a point process is characterized by an explicitly defined intensity function, which depends on the prior knowledge of some specific tasks. Thus, designing a proper model is expensive and time-consuming, with also limited ability to generalize well. To tackle this problem, we adopt the convolutional recurrent neural network (conv-RNN) to instantiate the point process, where its intensity function is automatically modeled by the training data. Furthermore, we show that our method captures both temporal and spatial evolution, which is essential in modeling events for MOT. Experimental results demonstrate notable improvements in addressing noisy and confusing detection results in MOT data sets. An improved state-of-the-art performance is achieved by incorporating our baseline MOT algorithm with the spatio-temporal point process model.

Item Type:	Article
Uncontrolled Keywords:	Noise measurement, Trajectory, Task analysis, Object tracking, Object detection, Time series analysis, Data models
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK5101-6720 Telecommunication. Including telegraphy, telephone, radio, radar, television
Divisions:	Faculty of Computing and Informatics (FCI)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	02 May 2023 07:59
Last Modified:	02 May 2023 07:59
URII:	http://shdl.mmu.edu.my/id/eprint/11394

Downloads

Edit (login required)