Explainable Deep Learning Improves Physician Interpretation of Myocardial Perfusion Imaging.

Journal: Journal of nuclear medicine : official publication, Society of Nuclear Medicine
Published Date:

Abstract

Artificial intelligence may improve accuracy of myocardial perfusion imaging (MPI) but will likely be implemented as an aid to physician interpretation rather than an autonomous tool. Deep learning (DL) has high standalone diagnostic accuracy for obstructive coronary artery disease (CAD), but its influence on physician interpretation is unknown. We assessed whether access to explainable DL predictions improves physician interpretation of MPI. We selected a representative cohort of patients who underwent MPI with reference invasive coronary angiography. Obstructive CAD, defined as stenosis ≥50% in the left main artery or ≥70% in other coronary segments, was present in half of the patients. We used an explainable DL model (CAD-DL), which was previously developed in a separate population from different sites. Three physicians interpreted studies first with clinical history, stress, and quantitative perfusion, then with all the data plus the DL results. Diagnostic accuracy was assessed using area under the receiver-operating-characteristic curve (AUC). In total, 240 patients with a median age of 65 y (interquartile range 58-73) were included. The diagnostic accuracy of physician interpretation with CAD-DL (AUC 0.779) was significantly higher than that of physician interpretation without CAD-DL (AUC 0.747, = 0.003) and stress total perfusion deficit (AUC 0.718, < 0.001). With matched specificity, CAD-DL had higher sensitivity when operating autonomously compared with readers without DL results ( < 0.001), but not compared with readers interpreting with DL results ( = 0.122). All readers had numerically higher accuracy with CAD-DL, with AUC improvement 0.02-0.05, and interpretation with DL resulted in overall net reclassification improvement of 17.2% (95% CI 9.2%-24.4%, < 0.001). Explainable DL predictions lead to meaningful improvements in physician interpretation; however, the improvement varied across the readers, reflecting the acceptance of this new technology. This technique could be implemented as an aid to physician diagnosis, improving the diagnostic accuracy of MPI.

Authors

  • Robert J H Miller
    Department of Imaging and Medicine and the Smidt Heart Institute (E.E., S.C., H.G., S.C., R.J.H.M., P.J.S., B.K.T., D.S.B.), Cedars-Sinai Medical Center, Los Angeles, CA.
  • Keiichiro Kuronuma
    Department of Imaging, Cedars-Sinai Medical Center, Los Angeles, CA, USA; Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
  • Ananya Singh
    Departments of Imaging, Medicine and Biomedical Sciences, Division of Artificial Intelligence in Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA. Ananya.Singh@cshs.org.
  • Yuka Otaki
    Department of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California.
  • Sean Hayes
    Division of Artificial Intelligence in Medicine, Department of Medicine, Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California.
  • Panithaya Chareonthaitawee
    Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN.
  • Paul Kavanagh
    Division of Artificial Intelligence in Medicine, Department of Medicine, Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California.
  • Tejas Parekh
    Division of Artificial Intelligence in Medicine, Department of Medicine, Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California.
  • Balaji K Tamarappoo
  • Tali Sharir
    Department of Nuclear Cardiology, Assuta Medical Centers, Tel Aviv, Israel.
  • Andrew J Einstein
    Division of Cardiology, Department of Medicine, Columbia University Medical Center and New York-Presbyterian Hospital, New York, New York; Department of Radiology, Columbia University Medical Center and New York-Presbyterian Hospital, New York, New York.
  • Mathews B Fish
    Oregon Heart and Vascular Institute, Sacred Heart Medical Center, Springfield, Oregon.
  • Terrence D Ruddy
    Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Canada.
  • Philipp A Kaufmann
    Cardiac Imaging, Department of Nuclear Medicine, University Hospital Zurich, Zurich, Switzerland; and.
  • Albert J Sinusas
    Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut.
  • Edward J Miller
    Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, CT, United States.
  • Timothy M Bateman
    Cardiovascular Imaging Technologies LLC, Kansas City, Missouri.
  • Sharmila Dorbala
    Department of Radiology, Division of Nuclear Medicine and Molecular Imaging, Brigham and Women's Hospital, Boston, Massachusetts.
  • Marcelo Di Carli
    Department of Radiology, Division of Nuclear Medicine and Molecular Imaging, Brigham and Women's Hospital, Boston, Massachusetts.
  • Sebastien Cadet
  • Joanna X Liang
    Division of Nuclear Medicine, Department of Imaging, and Departments of Medicine and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California.
  • Damini Dey
    Departments of Imaging and Medicine, and Cedars-Sinai Heart Institute, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Taper A238, Los Angeles, CA, 90048, USA.
  • Daniel S Berman
    Departments of Imaging and Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
  • Piotr J Slomka
    Department of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California Piotr.Slomka@cshs.org.