A survey of transformer-based architectures in medical image analysis: models, applications, and challenges

Ansari, S, Faraji, N, Topham, L ORCID: 0000-0002-6689-7944, Khan, W ORCID: 0000-0002-7511-3873, Shehada, D, Mahmoud, S, Tawfik, H and Hussain, AJ (2026) A survey of transformer-based architectures in medical image analysis: models, applications, and challenges. Frontiers in Artificial Intelligence, 9. ISSN 2624-8212

Preview

Text A survey of transformer-based architectures in medical image analysis -models, applications, and challenges.pdf - Published Version Available under License Creative Commons Attribution. Download (5MB) | Preview

Abstract

Transformer-based architectures have become central to medical image analysis, yet their practical value remains difficult to assess because studies vary widely in tasks, datasets, validation protocols, baselines, and reporting quality. This survey critically reviews recent transformer-based, hybrid, foundation, and transformer-alternative models across segmentation, classification, reconstruction, and image registration. A total of 128 studies published between 2021 and 2026 are organized using a task-, modality-, and architecture-aware taxonomy, with reported performance synthesized alongside baseline comparisons, reproducibility, computational cost, and clinical-readiness evidence. The findings indicate that the most convincing gains arise from task-adapted hybrid designs that combine local feature extraction with global context modeling, rather than from an unconditional superiority of transformers over convolutional networks. Persistent gaps include non-standardized benchmarks, limited external validation, incomplete code and weight availability, inconsistent efficiency reporting, weak uncertainty analysis, and insufficient clinical evaluation. Progress will require transparent reporting, multicenter validation, and clinically grounded assessment.

Item Type:	Article
Uncontrolled Keywords:	4007 Control engineering, mechatronics and robotics; 4602 Artificial intelligence; 4611 Machine learning
Subjects:	Q Science > QA Mathematics > QA76 Computer software R Medicine > R Medicine (General)
Divisions:	Computer Science and Mathematics
Publisher:	Frontiers Media SA
Date of acceptance:	13 July 2026
Date of first compliant Open Access:	7 August 2026
Date Deposited:	07 Aug 2026 14:22
Last Modified:	07 Aug 2026 14:22
DOI or ID number:	10.3389/frai.2026.1873938
URI:	https://researchonline.ljmu.ac.uk/id/eprint/29123

View Item