Investigation of optimal convolutional neural network conditions for thyroid ultrasound image analysis.

Journal: Scientific reports
Published Date:

Abstract

Neural network models have been used to analyze thyroid ultrasound (US) images and stratify malignancy risk of the thyroid nodules. We investigated the optimal neural network condition for thyroid US image analysis. We compared scratch and transfer learning models, performed stress tests in 10% increments, and compared the performance of three threshold values. All validation results indicated superiority of the transfer learning model over the scratch model. Stress test indicated that training the algorithm using 3902 images (70%) resulted in a performance which was similar to the full dataset (5575). Threshold 0.3 yielded high sensitivity (1% false negative) and low specificity (72% false positive), while 0.7 gave low sensitivity (22% false negative) and high specificity (23% false positive). Here we showed that transfer learning was more effective than scratch learning in terms of area under curve, sensitivity, specificity and negative/positive predictive value, that about 3900 images were minimally required to demonstrate an acceptable performance, and that algorithm performance can be customized according to the population characteristics by adjusting threshold value.

Authors

  • Joon-Hyop Lee
    Department of Surgery, Gachon University College of Medicine, Gil Medical Center, Incheon, South Korea.
  • Young-Gon Kim
    Department of Biomedical Engineering, Asan Institute of Life Science, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul, South Korea.
  • Youngbin Ahn
    Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea.
  • Seyeon Park
    Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea.
  • Hyoun-Joong Kong
    Department of Biomedical Engineering, Chungnam National University College of Medicine, Daejeon, Korea.
  • June Young Choi
  • Kwangsoon Kim
    The Catholic University of Korea, Seoul, Korea.
  • Inn-Chul Nam
    Department of Otolaryngology-Head and Neck Surgery, College of Medicine, The Catholic University of Korea, Seoul, Korea.
  • Myung-Chul Lee
    Division of Head and Neck Surgery, Department of Otolaryngology, Stanford University, Palo Alto, California, USA.
  • Hiroo Masuoka
    Department of Surgery, Kuma Hospital, Kobe, Japan.
  • Akira Miyauchi
    Department of Surgery, Kuma Hospital, Kobe, Japan.
  • Sungwan Kim
    Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Republic of Korea.
  • Young A Kim
    Department of Pathology, Seoul Metropolitan Government Seoul National University Boramae Medical Center, Seoul, Korea.
  • Eun Kyung Choe
    Department of Surgery, Seoul National University Hospital Healthcare System Gangnam Center, 39FL Gangnam Finance Center 152, Teheran-ro, Gangnam-gu, Seoul, 135-984, South Korea. snuhcr@naver.com.
  • Young Jun Chai
    Department of Surgery, Seoul National University Boramae Hospital, Seoul, Korea.