Enhancing lesion detection in automated breast ultrasound using unsupervised multi-view contrastive learning with 3D DETR.

Journal: Medical image analysis
PMID:

Abstract

The inherent variability of lesions poses challenges in leveraging AI in 3D automated breast ultrasound (ABUS) for lesion detection. Traditional methods based on single scans have fallen short compared to comprehensive evaluations by experienced sonologists using multiple scans. To address this, our study introduces an innovative approach combining the multi-view co-attention mechanism (MCAM) with unsupervised contrastive learning. Rooted in the detection transformer (DETR) architecture, our model employs a one-to-many matching strategy, significantly boosting training efficiency and lesion recall metrics. The model integrates MCAM within the decoder, facilitating the interpretation of lesion data across diverse views. Simultaneously, unsupervised multi-view contrastive learning (UMCL) aligns features consistently across scans, improving detection performance. When tested on two multi-center datasets comprising 1509 patients, our approach outperforms existing state-of-the-art 3D detection models. Notably, our model achieves a 90.3% cancer detection rate with a false positive per image (FPPI) rate of 0.5 on the external validation dataset. This surpasses junior sonologists and matches the performance of seasoned experts.

Authors

  • Xing Tao
    China (Guangxi)-ASEAN Joint Laboratory of Emerging Infectious Diseases, Guangxi Medical University, Nanning, Guangxi, PR China.
  • Yan Cao
    School of Pharmacy, Second Military Medical University, 325 Guohe Road, Shanghai, 200433, China.
  • Yanhui Jiang
    Department of Ultrasound, Remote Consultation Center of ABUS, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China.
  • Xiaoxi Wu
    Department of Ultrasound, Remote Consultation Center of ABUS, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China.
  • Dan Yan
    Department of Pharmacy, the First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China.
  • Wen Xue
    Department of Endocrinology and Metabolism, Qilu Hospital, Shandong University, Jinan, China.
  • Shulian Zhuang
    Department of Ultrasound, Remote Consultation Center of ABUS, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China.
  • Xin Yang
    Department of Oral Maxillofacial-Head Neck Oncology, Ninth People's Hospital, College of Stomatology, Shanghai Jiao Tong University School of Medicine, National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology & Shanghai Research Institute of Stomatology, Shanghai, China.
  • Ruobing Huang
    Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, UK. Electronic address: ruobing.huang@eng.ox.ac.uk.
  • Jianxing Zhang
    Hubei Key Laboratory of Intelligent Robot, Wuhan Institute of Technology, Wuhan 430205, China; School of Computer Science & Engineering, Wuhan Institute of Technology, Wuhan 430205, China.
  • Dong Ni