Learning co-plane attention across MRI sequences for diagnosing twelve types of knee abnormalities.

Journal: Nature communications
PMID:

Abstract

Multi-sequence magnetic resonance imaging is crucial in accurately identifying knee abnormalities but requires substantial expertise from radiologists to interpret. Here, we introduce a deep learning model incorporating co-plane attention across image sequences to classify knee abnormalities. To assess the effectiveness of our model, we collected the largest multi-sequence knee magnetic resonance imaging dataset involving the most comprehensive range of abnormalities, comprising 1748 subjects and 12 types of abnormalities. Our model achieved an overall area under the receiver operating characteristic curve score of 0.812. It achieved an average accuracy of 0.78, outperforming junior radiologists (accuracy 0.65) and remains competitive with senior radiologists (accuracy 0.80). Notably, with the assistance of model output, the diagnosis accuracy of all radiologists was improved significantly (p < 0.001), elevating from 0.73 to 0.79 on average. The interpretability analysis demonstrated that the model decision-making process is consistent with the clinical knowledge, enhancing its credibility and reliability in clinical practice.

Authors

  • Zelin Qiu
    Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong, China.
  • Zhuoyao Xie
    Department of Radiology, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics, Guangdong Province), Guangzhou, Guangdong, China.
  • Huangjing Lin
  • Yanwen Li
    AI Research Lab, Imsight Technology Co., Ltd., Shenzhen, Guangdong, China.
  • Qiang Ye
    Department of Mathematics, Departments of Computer Science and Internal Medicine University of Kentucky, Lexington, Kentucky 40506-0027.
  • Menghong Wang
    Department of Radiology, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics, Guangdong Province), Guangzhou, Guangdong, China.
  • Shisi Li
    Department of Radiology, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics, Guangdong Province), 183 Zhongshan Da Dao Xi, Guangzhou, Guangdong, 510630, China. Electronic address: lisisi1217@126.com.
  • Yinghua Zhao
    Department of Radiology, The Third Affiliated Hospital of Southern Medical University (Academy of Orthopedics, Guangdong Province), Guangzhou, Guangdong, China. zyh7258957@163.com.
  • Hao Chen
    The First School of Medicine, Wenzhou Medical University, Wenzhou, China.