Effect of Contrast Level and Image Format on a Deep Learning Algorithm for the Detection of Pneumothorax with Chest Radiography.

Journal: Journal of digital imaging
Published Date:

Abstract

Under the black-box nature in the deep learning model, it is uncertain how the change in contrast level and format affects the performance. We aimed to investigate the effect of contrast level and image format on the effectiveness of deep learning for diagnosing pneumothorax on chest radiographs. We collected 3316 images (1016 pneumothorax and 2300 normal images), and all images were set to the standard contrast level (100%) and stored in the Digital Imaging and Communication in Medicine and Joint Photographic Experts Group (JPEG) formats. Data were randomly separated into 80% of training and 20% of test sets, and the contrast of images in the test set was changed to 5 levels (50%, 75%, 100%, 125%, and 150%). We trained the model to detect pneumothorax using ResNet-50 with 100% level images and tested with 5-level images in the two formats. While comparing the overall performance between each contrast level in the two formats, the area under the receiver-operating characteristic curve (AUC) was significantly different (all p < 0.001) except between 125 and 150% in JPEG format (p = 0.382). When comparing the two formats at same contrast levels, AUC was significantly different (all p < 0.001) except 50% and 100% (p = 0.079 and p = 0.082, respectively). The contrast level and format of medical images could influence the performance of the deep learning model. It is required to train with various contrast levels and formats of image, and further image processing for improvement and maintenance of the performance.

Authors

  • Myeong Seong Yoon
    Department of Emergency Medicine, College of Medicine, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul, 04763, Republic of Korea.
  • Gitaek Kwon
    Department of Computer Science, Hanyang University, 222 Wangsimni-Ro, Seongdong-Gu, Seoul, 04763, Republic of Korea.
  • Jaehoon Oh
    Department of Emergency Medicine, College of Medicine, Hanyang University, Seoul, Korea.
  • Jongbin Ryu
    Department of Computer Engineering, Ajou University, Republic of Korea; Department of Artificial Intelligence, Ajou University, Republic of Korea. Electronic address: jongbinryu@ajou.ac.kr.
  • Jongwoo Lim
  • Bo-Kyeong Kang
    From the Department of Computer Science, Hanyang University, Seoul, Republic of Korea (K.J.C.); Department of Radiology and Research Institute of Radiology (J.K.J., S.S.L., Y.S.S., W.H.S., H.S.K., J.Y., J.H.K., S.Y.K.) and Department of Diagnostic Pathology (E.S.Y.), Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, South Korea; Department of Radiology, Severance Hospital, Yonsei University College of Medicine, Seoul, Korea (J.Y.C.); Department of Radiology, Haeundae Paik Hospital, Inje University College of Medicine, Busan, Korea (Y.L.); and Department of Radiology, Hanyang University Medical Center, Hanyang University School of Medicine, Seoul, Korea (B.K.K.).
  • Juncheol Lee
    Department of Emergency Medicine, College of Medicine, Hanyang University, 222 Wangsimni-Ro, Seongdong-Gu, Seoul, 04763, Republic of Korea.
  • Dong-Kyoon Han
    Department of Radiological Science, Eulji University, 553 Sanseong-daero, Seongnam-si, Gyeonggi Do, 13135, Republic of Korea.