Lymph Node Metastasis Prediction from Primary Breast Cancer US Images Using Deep Learning.

Journal: Radiology
Published Date: Nov 19, 2019

Abstract

Background Deep learning (DL) algorithms are gaining extensive attention for their excellent performance in image recognition tasks. DL models can automatically make a quantitative assessment of complex medical image characteristics and achieve increased accuracy in diagnosis with higher efficiency. Purpose To determine the feasibility of using a DL approach to predict clinically negative axillary lymph node metastasis from US images in patients with primary breast cancer. Materials and Methods A data set of US images in patients with primary breast cancer with clinically negative axillary lymph nodes from Tongji Hospital (974 imaging studies from 2016 to 2018, 756 patients) and an independent test set from Hubei Cancer Hospital (81 imaging studies from 2018 to 2019, 78 patients) were collected. Axillary lymph node status was confirmed with pathologic examination. Three different convolutional neural networks (CNNs) of Inception V3, Inception-ResNet V2, and ResNet-101 architectures were trained on 90% of the Tongji Hospital data set and tested on the remaining 10%, as well as on the independent test set. The performance of the models was compared with that of five radiologists. The models' performance was analyzed in terms of accuracy, sensitivity, specificity, receiver operating characteristic curves, areas under the receiver operating characteristic curve (AUCs), and heat maps. Results The best-performing CNN model, Inception V3, achieved an AUC of 0.89 (95% confidence interval [CI]: 0.83, 0.95) in the prediction of the final clinical diagnosis of axillary lymph node metastasis in the independent test set. The model achieved 85% sensitivity (35 of 41 images; 95% CI: 70%, 94%) and 73% specificity (29 of 40 images; 95% CI: 56%, 85%), and the radiologists achieved 73% sensitivity (30 of 41 images; 95% CI: 57%, 85%; = .17) and 63% specificity (25 of 40 images; 95% CI: 46%, 77%; = .34). Conclusion Using US images from patients with primary breast cancer, deep learning models can effectively predict clinically negative axillary lymph node metastasis. Artificial intelligence may provide an early diagnostic strategy for lymph node metastasis in patients with breast cancer with clinically negative lymph nodes. Published under a CC BY 4.0 license. See also the editorial by Bae in this issue.

Authors

  • Li-Qiang Zhou
    Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China.
  • Xing-Long Wu
    School of Mathematics and Computer Science, Wuhan Textitle University, Wuhan 430200, Hubei Province, China.
  • Shu-Yan Huang
    From the Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China (L.Q.Z., G.G.W., Q.W., Y.B.D., X.W.C., C.F.D.); School of Mathematics and Computer Science, Wuhan Textile University, Wuhan, Hubei Province, China (X.L.W.); Department of Ultrasound, The First People's Hospital of Huaihua, University of South China, Huaihua, China (S.Y.H.); Department of Ultrasound, China Resources & Wisco General Hospital, Wuhan, Hubei Province, China (H.R.Y.); Department of Ultrasound, Affiliated Hangzhou First People's Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China (L.Y.B.); Department of Thyroid and Breast Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei Province, China (X.R.L.); and Medical Clinic 2, Caritas-Krankenhaus Bad Mergentheim, Academic Teaching Hospital of the University of Wuerzburg, Bad Mergentheim, Germany (C.F.D.).
  • Ge-Ge Wu
    Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China.
  • Hua-Rong Ye
    From the Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China (L.Q.Z., G.G.W., Q.W., Y.B.D., X.W.C., C.F.D.); School of Mathematics and Computer Science, Wuhan Textile University, Wuhan, Hubei Province, China (X.L.W.); Department of Ultrasound, The First People's Hospital of Huaihua, University of South China, Huaihua, China (S.Y.H.); Department of Ultrasound, China Resources & Wisco General Hospital, Wuhan, Hubei Province, China (H.R.Y.); Department of Ultrasound, Affiliated Hangzhou First People's Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China (L.Y.B.); Department of Thyroid and Breast Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei Province, China (X.R.L.); and Medical Clinic 2, Caritas-Krankenhaus Bad Mergentheim, Academic Teaching Hospital of the University of Wuerzburg, Bad Mergentheim, Germany (C.F.D.).
  • Qi Wei
  • Ling-Yun Bao
    From the Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China (L.Q.Z., G.G.W., Q.W., Y.B.D., X.W.C., C.F.D.); School of Mathematics and Computer Science, Wuhan Textile University, Wuhan, Hubei Province, China (X.L.W.); Department of Ultrasound, The First People's Hospital of Huaihua, University of South China, Huaihua, China (S.Y.H.); Department of Ultrasound, China Resources & Wisco General Hospital, Wuhan, Hubei Province, China (H.R.Y.); Department of Ultrasound, Affiliated Hangzhou First People's Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China (L.Y.B.); Department of Thyroid and Breast Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei Province, China (X.R.L.); and Medical Clinic 2, Caritas-Krankenhaus Bad Mergentheim, Academic Teaching Hospital of the University of Wuerzburg, Bad Mergentheim, Germany (C.F.D.).
  • You-Bin Deng
    Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China.
  • Xing-Rui Li
    From the Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China (L.Q.Z., G.G.W., Q.W., Y.B.D., X.W.C., C.F.D.); School of Mathematics and Computer Science, Wuhan Textile University, Wuhan, Hubei Province, China (X.L.W.); Department of Ultrasound, The First People's Hospital of Huaihua, University of South China, Huaihua, China (S.Y.H.); Department of Ultrasound, China Resources & Wisco General Hospital, Wuhan, Hubei Province, China (H.R.Y.); Department of Ultrasound, Affiliated Hangzhou First People's Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China (L.Y.B.); Department of Thyroid and Breast Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei Province, China (X.R.L.); and Medical Clinic 2, Caritas-Krankenhaus Bad Mergentheim, Academic Teaching Hospital of the University of Wuerzburg, Bad Mergentheim, Germany (C.F.D.).
  • Xin-Wu Cui
    Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China.
  • Christoph F Dietrich
    Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China.

Keywords

External Resources

Popular Topics
Recent Journals