Automatic Grading Assessments for Knee MRI Cartilage Defects via Self-ensembling Semi-supervised Learning with Dual-Consistency.

Journal: Medical image analysis
Published Date:

Abstract

Knee cartilage defects caused by osteoarthritis are major musculoskeletal disorders, leading to joint necrosis or even disability if not intervened at early stage. Deep learning has demonstrated its effectiveness in computer-aided diagnosis, but it is time-consuming to prepare a large set of well-annotated data by experienced radiologists for model training. In this paper, we propose a semi-supervised framework to effectively use unlabeled data for better evaluation of knee cartilage defect grading. Our framework is developed based on the widely-used mean-teacher classification model, by designing a novel dual-consistency strategy to boost the consistency between the teacher and student models. The main contributions are three-fold: (1) We define an attention loss function to make the network focus on the cartilage regions, which can both achieve accurate attention masks and boost classification performance simultaneously; (2) Besides enforcing the consistency of classification results, we further design a novel attention consistency mechanism to ensure the focusing of the student and teacher networks on the same defect regions; (3) We introduce an aggregation approach to ensemble the slice-level classification outcomes for deriving the final subject-level diagnosis. Experimental results show that our proposed method can significantly improve both classification and localization performances of knee cartilage defects. Our code is available on https://github.com/King-HAW/DC-MT.

Authors

  • Jiayu Huo
  • Xi Ouyang
  • Liping Si
    Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Changning District, Shanghai, 200336, China.
  • Kai Xuan
    Institute for Medical Imaging Technology, School of Biomedical Engineering, Shanghai Jiao Tong University, Huashan Road #1954, Shanghai, 200030, China.
  • Sheng Wang
    Intensive Care Medical Center, Tongji Hospital, School of Medicine, Tongji University, Shanghai, 200065, People's Republic of China.
  • Weiwu Yao
    Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Changning District, Shanghai, 200336, China. yaoweiwuhuan@163.com.
  • Ying Liu
    The First School of Clinical Medicine, Lanzhou University, Lanzhou, China.
  • Jia Xu
    Key Laboratory of Flexible Electronics (KLOFE) & Institute of Advanced Materials (IAM), Jiangsu National Synergetic Innovation Center for Advanced Materials (SICAM), Nanjing Tech University (Nanjing Tech), 30 South Puzhu Road, Nanjing, 211816, P.R. China.
  • Dahong Qian
  • Zhong Xue
    Shanghai United Imaging Intelligence Co Ltd., Shanghai, China.
  • Qian Wang
    Department of Radiation Oncology, China-Japan Union Hospital of Jilin University, Changchun, China.
  • Dinggang Shen
    School of Biomedical Engineering, ShanghaiTech University, Shanghai, China.
  • Lichi Zhang
    School of Biomedical Engineering, Med-X Research Institute, Shanghai Jiao Tong University, Shanghai, China.