Transformer-based approaches for neuroimaging: an in-depth review of their role in classification and regression tasks.

Journal: Reviews in the neurosciences
Published Date:

Abstract

In the ever-evolving landscape of deep learning (DL), the transformer model emerges as a formidable neural network architecture, gaining significant traction in neuroimaging-based classification and regression tasks. This paper presents an extensive examination of transformer's application in neuroimaging, surveying recent literature to elucidate its current status and research advancement. Commencing with an exposition on the fundamental principles and structures of the transformer model and its variants, this review navigates through the methodologies and experimental findings pertaining to their utilization in neuroimage classification and regression tasks. We highlight the transformer model's prowess in neuroimaging, showcasing its exceptional performance in classification endeavors while also showcasing its burgeoning potential in regression tasks. Concluding with an assessment of prevailing challenges and future trajectories, this paper proffers insights into prospective research directions. By elucidating the current landscape and envisaging future trends, this review enhances comprehension of transformer's role in neuroimaging tasks, furnishing valuable guidance for further inquiry.

Authors

  • Xinyu Zhu
  • Shen Sun
    Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, China.
  • Lan Lin
    Department of Gastroenterology, Xiamen Humanity Hospital, Xiamen, Fujian, China.
  • Yutong Wu
    The Australian e-Health Research Centre, CSIRO, Brisbane, Australia.
  • Xiangge Ma
    Department of Biomedical Engineering, College of Chemistry and Life Science, Beijing University of Technology, Beijing 100124, China.