Citation
Noshin, Maimuna Biswas and Dutta, Monoronjon and Kaysar, Md Nadim and Sajib, Rakib Hossain and Hossen, Md Jakir and Nandi, Dip and Jubair, Abdullah Al and Rahman, Mashiour (2026) Medical visual question answering with multimodal: a systematic mini review (2023–2026). Frontiers in Digital Health, 8. ISSN 2673-253X|
Text
fdgth-8-1848710.pdf - Published Version Restricted to Repository staff only Download (1MB) |
Abstract
Medical visual question answering (Med-VQA) has emerged as a critical application of artificial intelligence within a short period of time. Large language models (LLMs) and vision-language models (VLMs) have fundamentally rewritten the architecture of medical question answering (QA). This study aims to systematically analyze recent developments in Med-VQA. Like past methods, which were simple, text-heavy database systems, there has been a shift toward multimodal frameworks. Recent methods are now highly capable of explaining radiology, pathology, and dermatological images along with clinical questions. This review was conducted following PRISMA guidelines, covering 27 representative studies published in various databases, using predefined inclusion and exclusion criteria. The findings reveal a clear shift toward generative models, supported by retrieval mechanisms and structured reasoning strategies such as Chain-of-Thought and multi-agent frameworks. Generative models, along with retrieval-augmented generation (RAG) and preference optimization, are not just more consistent than traditional classification-based methods but also can enable free-form clinical question answering. Though frameworks like multi-agent and hierarchical CoT have significantly improved interpretability and mitigated hallucinations, they also come with some limitations, like higher computational time, multi-view analysis, multi-lingual question answering, lack of standardized evaluation and exploration, domain-specific evaluation, and real-world clinical settings. MedVQA systems demonstrate significant potential as a clinical decision answer generation with a vision language model. Future work should focus on computational efficiency during real-world validation, fairness evaluation, standardized diagnostic benchmarks, and interpretable reasoning frameworks including specialized domain knowledge and practical skills.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Generative AI in healthcare |
| Subjects: | R Medicine > R Medicine (General) > R856-857 Biomedical engineering. Electronics. Instrumentation |
| Divisions: | Faculty of Engineering and Technology (FET) |
| Depositing User: | Ms Rosnani Abd Wahab |
| Date Deposited: | 04 Aug 2026 02:28 |
| Last Modified: | 04 Aug 2026 02:28 |
| URII: | http://shdl.mmu.edu.my/id/eprint/16460 |
Downloads
Downloads per month over past year
Edit (login required) |
