Inconsistency in the use of the term "validation" in studies reporting the performance of deep learning algorithms in providing diagnosis from medical imaging.

Journal: PloS one
PMID: 32915901

Abstract

BACKGROUND: The development of deep learning (DL) algorithms is a three-step process-training, tuning, and testing. Studies are inconsistent in the use of the term "validation", with some using it to refer to tuning and others testing, which hinders accurate delivery of information and may inadvertently exaggerate the performance of DL algorithms. We investigated the extent of inconsistency in usage of the term "validation" in studies on the accuracy of DL algorithms in providing diagnosis from medical imaging.

Authors

  • Dong Wook Kim
    3 Department of Orthopedic Surgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea.
  • Hye Young Jang
    Department of Radiology, National Cancer Center, Goyang, Republic of Korea.
  • Yousun Ko
    Biomedical Research Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Republic of Korea.
  • Jung Hee Son
    Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
  • Pyeong Hwa Kim
    Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
  • Seon-Ok Kim
    Department of Clinical Epidemiology and Biostatistics, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
  • Joon Seo Lim
    Scientific Publications Team, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
  • Seong Ho Park
    From the Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, South Korea (S.H.P.); and Department of Radiology, Research Institute of Radiological Science, Yonsei University College of Medicine, Seoul, South Korea (K.H.).

Keywords

External Resources

Popular Topics
Recent Journals