Citation

Abdul Rauf, Sarah Shamina and Mohd Hilmi Tan, Mas Ira Syafila and Loh, Yuen Peng (2024) Multi-band Satellite Image Analysis for Multi-label Classification. In: 2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 03-06 December 2024, Macau, Macao.

Text Multi-band Satellite Image Analysis for Multi-label Classification.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

Multispectral satellite imagery captures rich information of the Earth surface from an extensive range of wavelengths that enhances the understanding and discrimination of Earth objects. When integrated with multi-label classification, it has great potential to provide perceptual comprehension of land cover that exceeds the details observable from the visible light spectrum (RGB). However, the variety of spectral bands each capture a different aspect of the earth, thus can be challenging to identify the optimal spectral band, and their combinations for a classification task. To overcome these issues, this study leverages on deep learning by exploring various band combinations and neural network architectures for multilabel classification. Specifically, the performance of triplet band combinations was explored and compared against standard RGB imagery, using ResNet101 as the backbone and the incorporation of the Class Specific Residual Attention (CSRA) mechanism. We then propose the multi-stream triplet band fusion model with Vision Transformer (ViT) backbone and CSRA for multilabel satellite image classification. We found that in the single triple band input approach, the ShortWave InfraRed (SWIR1 or SWIR2) combinations is able to improve F1 scores by 1.25% to 2.02% compared to models using only RGB bands. More notably, our proposed multi-stream approach that fuses the triplets of RGB and Vegetation bands outperformed all other models with an F1 score of 0.7484, consistently surpassing the ResNet-101 backbone baseline with similar configurations. These findings reveal the potential of band combination approaches to enhance the Earth object discrimination and land cover analysis.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	Earth, deep learning
Divisions:	Faculty of Computing and Informatics (FCI)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	28 Feb 2025 04:06
Last Modified:	28 Feb 2025 04:06
URII:	http://shdl.mmu.edu.my/id/eprint/13545

Downloads

Edit (login required)