Citation

Lim, Yu Jie and Lim, Kian Ming and Chang, Roy Kwang Yang and Lee, Chin Poo and Lim, Jit Yan (2023) ViTMed: Vision Transformer for Medical Image Analysis. In: 2023 11th International Conference on Information and Communication Technology (ICoICT), 23-24 August 2023, Melaka, Malaysia.

Text 6.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

The COVID-19 global health crisis has presented daunting challenges to medical professionals, making accurate and efficient diagnoses more important than ever. In view of this, this paper proposes a Vision Transformer model, ViTMed, with an attention mechanism to classify the CT scan images for more effective diagnosis of COVID-19. Given the input CT scan images, it is represented as sequences of tokens and a transformer is utilized to capture global and local dependencies between features by utilizing self-attention mechanism. The core element in ViTMed is the transformer encoder with multi-headed attention (MHA) mechanism and feed-forward network. This enables model to learn hierarchical representation of image and make more informed predictions. The proposed ViTMed achieves promising performance with fewer parameters and computations than conventional Convolutional Neural Networks. From the experimental results, the proposed ViTMed outperforms state-of-the-art approaches for all three public benchmark datasets of COVID-19, 98.38%, 90.48%, and 99.17% accuracy for SARS-CoV-2-CT, COVID-CT, and iCTCF datasets, respectively. The number of samples collected for each dataset are 2482, 746, 19685. The datasets consist of two to three classes, which are Covid, Non-Covid and Non-informative cases.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	Vision Transformer, Medical Image Analysis, Attention, COVID-19, CT-Scan
Subjects:	R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	01 Nov 2023 02:53
Last Modified:	01 Nov 2023 02:53
URII:	http://shdl.mmu.edu.my/id/eprint/11840

Downloads

Edit (login required)