Automated detection and classification of thyroid nodules in ultrasound images using clinical-knowledge-guided convolutional neural networks.

Journal: Medical image analysis
Published Date:

Abstract

Accurate diagnosis of thyroid nodules using ultrasonography is a valuable but tough task even for experienced radiologists, considering both benign and malignant nodules have heterogeneous appearances. Computer-aided diagnosis (CAD) methods could potentially provide objective suggestions to assist radiologists. However, the performance of existing learning-based approaches is still limited, for direct application of general learning models often ignores critical domain knowledge related to the specific nodule diagnosis. In this study, we propose a novel deep-learning-based CAD system, guided by task-specific prior knowledge, for automated nodule detection and classification in ultrasound images. Our proposed CAD system consists of two stages. First, a multi-scale region-based detection network is designed to learn pyramidal features for detecting nodules at different feature scales. The region proposals are constrained by the prior knowledge about size and shape distributions of real nodules. Then, a multi-branch classification network is proposed to integrate multi-view diagnosis-oriented features, in which each network branch captures and enhances one specific group of characteristics that were generally used by radiologists. We evaluated and compared our method with the state-of-the-art CAD methods and experienced radiologists on two datasets, i.e. Dataset I and Dataset II. The detection and diagnostic accuracy on Dataset I were 97.5% and 97.1%, respectively. Besides, our CAD system also achieved better performance than experienced radiologists on Dataset II, with improvements of accuracy for 8%. The experimental results demonstrate that our proposed method is effective in the discrimination of thyroid nodules.

Authors

  • Tianjiao Liu
    State Key Laboratory of Intelligent Technology and Systems, Department of Electronic Engineering, Tsinghua University, Beijing 100084, China; Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27599, USA. Electronic address: ltj14@mails.tsinghua.edu.cn.
  • Qianqian Guo
    National Cancer Center/Cancer Hospital of Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China.
  • Chunfeng Lian
    Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA. Electronic address: chunfeng_lian@med.unc.edu.
  • Xuhua Ren
    School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China.
  • Shujun Liang
    Guangdong Provincial Key Laboratory of Medical Image Processing, School of Biomedical Engineering, Southern Medical University, No. 1838 Guangzhou Northern Avenue, Baiyun District, Guangzhou, 510515, Guangdong, China.
  • Jing Yu
    Department of Ultrasound, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China.
  • Lijuan Niu
    National Cancer Center/Cancer Hospital of Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China. Electronic address: niulijuan8197@126.com.
  • Weidong Sun
    State Key Laboratory of Intelligent Technology and Systems, Department of Electronic Engineering, Tsinghua University, Beijing 100084, China. Electronic address: wdsun@tsinghua.edu.cn.
  • Dinggang Shen
    School of Biomedical Engineering, ShanghaiTech University, Shanghai, China.