Citation

Mazlan, Aqilah and Ng, Yin Hoe and Tan, Chee Keong (2022) Teacher-Assistant Knowledge Distillation Based Indoor Positioning System. Sustainability, 14 (21). p. 14652. ISSN 2071-1050

Text 4.pdf - Published Version Restricted to Repository staff only Download (2MB)

Abstract

Indoor positioning systems have been of great importance, especially for applications that require the precise location of objects and users. Convolutional neural network-based indoor positioning systems (IPS) have garnered much interest in recent years due to their ability to achieve high positioning accuracy and low positioning error, regardless of signal fluctuation. Nevertheless, a powerful CNN framework comes with a high computational cost. Hence, there will be difficulty in deploying such a system on a computationally restricted device. Knowledge distillation has been an excellent solution which allows smaller networks to imitate the performance of larger networks. However, problems such as degradation in the student’s positioning performance, occur when a far more complex CNN is used to train a small CNN, because the small CNN does not have the ability to fully capture the knowledge that has been passed down. In this paper, we implemented the teacher-assistant framework to allow a simple CNN indoor positioning system to closely imitate a superior indoor positioning scheme. The framework involves transferring knowledge from a large pre-trained network to a small network by passing through an intermediate network. Based on our observation, the positioning error of a small network can be reduced to up to 38.79% by implementing the teacher-assistant knowledge distillation framework, while a typical knowledge distillation framework can only reduce the error to 30.18%.

Item Type:	Article
Uncontrolled Keywords:	Indoor positioning, received signal strength indicator, convolutional neural networks, knowledge distillation, teacher assistant
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Engineering (FOE)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	04 Jan 2023 03:02
Last Modified:	04 Jan 2023 03:02
URII:	http://shdl.mmu.edu.my/id/eprint/10737

Downloads

Edit (login required)