Tractography-Based Automated Identification of Retinogeniculate Visual Pathway With Novel Microstructure-Informed Supervised Contrastive Learning.

Journal: Human brain mapping
PMID:

Abstract

The retinogeniculate visual pathway (RGVP) is responsible for carrying visual information from the retina to the lateral geniculate nucleus. Identification and visualization of the RGVP are important in studying the anatomy of the visual system and can inform the treatment of related brain diseases. Diffusion MRI (dMRI) tractography is an advanced imaging method that uniquely enables in vivo mapping of the 3D trajectory of the RGVP. Currently, identification of the RGVP from tractography data relies on expert (manual) selection of tractography streamlines, which is time-consuming, has high clinical and expert labor costs, and is affected by inter-observer variability. In this paper, we present a novel deep learning framework, DeepRGVP, to enable fast and accurate identification of the RGVP from dMRI tractography data. We design a novel microstructure-informed supervised contrastive learning method that leverages both streamline label and tissue microstructure information to determine positive and negative pairs. We propose a new streamline-level data augmentation method to address highly imbalanced training data, where the number of RGVP streamlines is much lower than that of non-RGVP streamlines. In the experiments, we perform comparisons with several state-of-the-art deep learning methods that were designed for tractography parcellation. Furthermore, to assess the generalizability of the proposed RGVP method, we apply our method to dMRI tractography data from neurosurgical patients with pituitary tumors. In comparison with the state-of-the-art methods, we show superior RGVP identification results using DeepRGVP with significantly higher accuracy and F1 scores. In the patient data experiment, we show DeepRGVP can successfully identify RGVPs despite the effect of lesions affecting the RGVPs. Overall, our study shows the high potential of using deep learning to automatically identify the RGVP.

Authors

  • Sipei Li
    School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China.
  • Wei Zhang
    The First Affiliated Hospital of Nanchang University, Nanchang, China.
  • Shun Yao
    Navy Clinical Medical School, Anhui Medical University, No. 81, Meishan Road, Hefei, 230032, Anhui, China.
  • Jianzhong He
    College of Information Engineering, Zhejiang University of Technology, Hangzhou, China.
  • Jingjing Gao
    School of Electronic Engineering, University of Electronic Science and Technology of China, Xiyuan Ave. 2006, West Hi-Tech Zone, Chengdu, Sichuan, 611731, China.
  • Tengfei Xue
    Brigham and Women's Hospital, Harvard Medical School, Boston, USA; School of Computer Science, University of Sydney, Sydney, Australia.
  • Guoqiang Xie
    Nuclear Industry 215 Hospital of Shaanxi Province, Xianyang, 712000, China. Electronic address: 522802876@qq.com.
  • Yuqian Chen
  • Erickson F Torio
    Brigham and Women's Hospital, Harvard Medical School, Massachusetts, USA.
  • Yuanjing Feng
    Institute of Information Processing and Automation, College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China; Zhejiang Provincial United Key Laboratory of Embedded Systems, Hangzhou 310023, China. Electronic address: fyjing@zjut.edu.cn.
  • Dhiego C A Bastos
    Brigham and Women's Hospital, Harvard Medical School, Massachusetts, USA.
  • Yogesh Rathi
    Brigham and Women's Hospital, Harvard Medical School, Boston, USA.
  • Nikos Makris
    Harvard Medical School, Boston MA, USA.
  • Ron Kikinis
    Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States.
  • Wenya Linda Bi
    Department of Neurosurgery, Brigham and Women's Hospital, Boston, Massachusetts.
  • Alexandra J Golby
    Brigham and Women's Hospital, Harvard Medical School, Boston, USA.
  • Lauren J O'Donnell
    Brigham and Women's Hospital, Harvard Medical School, Boston, USA.
  • Fan Zhang
    Department of Anesthesiology, Bishan Hospital of Chongqing Medical University, Chongqing, China.