Artificial Intelligence Solution for Chest Radiographs in Respiratory Outpatient Clinics: Multicenter Prospective Randomized Clinical Trial.

Journal: Annals of the American Thoracic Society
Published Date:

Abstract

Artificial intelligence (AI)-assisted diagnosis imparts high accuracy to chest radiography (CXR) interpretation; however, its benefit for nonradiologist physicians in detecting lung lesions on CXR remains unclear. To investigate whether AI assistance improves the diagnostic performance of physicians for CXR interpretation and affects their clinical decisions in clinical practice. We randomly allocated eligible patients who visited an outpatient clinic to the intervention (with AI-assisted interpretation) and control (without AI-assisted interpretation) groups. Lung lesions on CXR were recorded by seven nonradiologists with or without AI assistance. The reference standard for lung lesions was established by three radiologists. The primary and secondary endpoints were the physicians' diagnostic accuracy and clinical decision, respectively. Between October 2020 and May 2021, 162 and 161 patients were assigned to the intervention and control groups, respectively. The area under the receiver operating characteristic curve was significantly larger in the intervention group than in the control group for the CXR level (0.840 [95% confidence interval (CI), 0.778-0.903] vs. 0.718 [95% CI, 0.640-0.796];  = 0.017) and lung lesion level (0.800 [95% CI, 0.740-0.861] vs. 0.677 [95% CI, 0.605-0.750];  = 0.011). The intervention group had higher sensitivity in terms of both CXR and lung lesion level and a lower false referral rate for the lung lesion level. AI-assisted CXR interpretation did not affect the physicians' clinical decisions. AI-assisted CXR interpretation improves the diagnostic performance of nonradiologist physicians in detecting abnormal lung findings. Clinical trial registered with Clinical Research Information Service of the Republic of Korea (KCT 0005466).

Authors

  • Hyun Woo Lee
    Division of Respiratory and Critical Care, Department of Internal Medicine, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, South Korea.
  • Kwang Nam Jin
    Department of Radiology, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, South Korea.
  • Sohee Oh
    Department of Biostatistics, Seoul National University College of Medicine and SMG-SNU Boramae Medical Center, Seoul, Korea.
  • Sung-Yoon Kang
    Department of Internal Medicine, Gachon University Gil Medical Center, Incheon, Republic of Korea.
  • Sang Min Lee
    Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Korea.
  • In Beom Jeong
    Department of Internal Medicine, College of Medicine.
  • Ji Woong Son
    Department of Internal Medicine, College of Medicine.
  • Ju Hyuck Han
    Department of Medical Engineering, Konyang University, Daejeon, Korea.
  • Eun Young Heo
    Division of Respiratory and Critical Care, Department of Internal Medicine.
  • Jung Gyu Lee
    Division of Respiratory and Critical Care, Department of Internal Medicine.
  • Young Jae Kim
    Department of Biomedical Engineering, College of Medicine, Gachon University, Gyeonggi-do, Republic of Korea.
  • Eun Young Kim
    Department of Surgery, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, Korea.
  • Young Jun Cho
    Department of Radiology, Konyang University Hospital, Daejeon, South Korea.