AAPM task group report 273: Recommendations on best practices for AI and machine learning for computer-aided diagnosis in medical imaging.

Journal: Medical physics
Published Date:

Abstract

Rapid advances in artificial intelligence (AI) and machine learning, and specifically in deep learning (DL) techniques, have enabled broad application of these methods in health care. The promise of the DL approach has spurred further interest in computer-aided diagnosis (CAD) development and applications using both "traditional" machine learning methods and newer DL-based methods. We use the term CAD-AI to refer to this expanded clinical decision support environment that uses traditional and DL-based AI methods. Numerous studies have been published to date on the development of machine learning tools for computer-aided, or AI-assisted, clinical tasks. However, most of these machine learning models are not ready for clinical deployment. It is of paramount importance to ensure that a clinical decision support tool undergoes proper training and rigorous validation of its generalizability and robustness before adoption for patient care in the clinic. To address these important issues, the American Association of Physicists in Medicine (AAPM) Computer-Aided Image Analysis Subcommittee (CADSC) is charged, in part, to develop recommendations on practices and standards for the development and performance assessment of computer-aided decision support systems. The committee has previously published two opinion papers on the evaluation of CAD systems and issues associated with user training and quality assurance of these systems in the clinic. With machine learning techniques continuing to evolve and CAD applications expanding to new stages of the patient care process, the current task group report considers the broader issues common to the development of most, if not all, CAD-AI applications and their translation from the bench to the clinic. The goal is to bring attention to the proper training and validation of machine learning algorithms that may improve their generalizability and reliability and accelerate the adoption of CAD-AI systems for clinical decision support.

Authors

  • Lubomir Hadjiiski
    Department of Radiology, The University of Michigan, Ann Arbor, Michigan 48109-0904.
  • Kenny Cha
    Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109.
  • Heang-Ping Chan
    Department of Radiology, University of Michigan, Ann Arbor, Michigan.
  • Karen Drukker
    Department of Radiology, University of Chicago, Chicago, IL, 60637, USA.
  • Lia Morra
    Dipartimento di Automatica e Informatica, Politecnico di Torino, Torino, Italy.
  • Janne J Näppi
    From the 3D Imaging Research Lab, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon St, Suite 400C, Boston, MA 02114 (R.T., J.J.N., N.K., T.H., H.Y.); Department of Information Science and Technology, National Institute of Technology, Oshima College, Yamaguchi, Japan (R.T.); Department of Medical Physics and Engineering, Graduate School of Medicine, Osaka University, Suita, Osaka, Japan (J.O.); Department of Medical Physics, University of Applied Sciences Giessen, Giessen, Germany (N.K.); Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea (S.H.K.); Department of Surgical Sciences, University of Torino, Turin, Italy (D.R.); and Candiolo Cancer Institute, Fondazione del Piemonte per l'Oncologia-Istituto di Ricovero e Cura a Carattere Scientifico (FPO-IRCCS), Candiolo, Turin, Italy (D.R.).
  • Berkman Sahiner
    Food and Drug Administration/CDRH, Silver Spring, USA.
  • Hiroyuki Yoshida
    From the 3D Imaging Research Lab, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon St, Suite 400C, Boston, MA 02114 (R.T., J.J.N., N.K., T.H., H.Y.); Department of Information Science and Technology, National Institute of Technology, Oshima College, Yamaguchi, Japan (R.T.); Department of Medical Physics and Engineering, Graduate School of Medicine, Osaka University, Suita, Osaka, Japan (J.O.); Department of Medical Physics, University of Applied Sciences Giessen, Giessen, Germany (N.K.); Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea (S.H.K.); Department of Surgical Sciences, University of Torino, Turin, Italy (D.R.); and Candiolo Cancer Institute, Fondazione del Piemonte per l'Oncologia-Istituto di Ricovero e Cura a Carattere Scientifico (FPO-IRCCS), Candiolo, Turin, Italy (D.R.).
  • Quan Chen
    Management School, Zhongshan Institute, University of Electronic Science and Technology of China, Guangdong, 528402, China.
  • Thomas M Deserno
    Department of Medical Informatics, RWTH Aachen University, Pauwelsstr. 30, 52057 Aachen, Germany.
  • Hayit Greenspan
  • Henkjan Huisman
    Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands.
  • Zhimin Huo
    Tencent America, Palo Alto, California, USA.
  • Richard Mazurchuk
    Division of Cancer Prevention, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA.
  • Nicholas Petrick
  • Daniele Regge
    From the 3D Imaging Research Lab, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon St, Suite 400C, Boston, MA 02114 (R.T., J.J.N., N.K., T.H., H.Y.); Department of Information Science and Technology, National Institute of Technology, Oshima College, Yamaguchi, Japan (R.T.); Department of Medical Physics and Engineering, Graduate School of Medicine, Osaka University, Suita, Osaka, Japan (J.O.); Department of Medical Physics, University of Applied Sciences Giessen, Giessen, Germany (N.K.); Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea (S.H.K.); Department of Surgical Sciences, University of Torino, Turin, Italy (D.R.); and Candiolo Cancer Institute, Fondazione del Piemonte per l'Oncologia-Istituto di Ricovero e Cura a Carattere Scientifico (FPO-IRCCS), Candiolo, Turin, Italy (D.R.).
  • Ravi Samala
    Department of Radiology, University of Michigan, Ann Arbor, MI, 48109, USA.
  • Ronald M Summers
    National Institutes of Health, Clinical Center, Radiology and Imaging Sciences, 10 Center Drive, Bethesda, MD 20892, USA.
  • Kenji Suzuki
    Department of General Thoracic Surgery, Juntendo University School of Medicine, Tokyo, Japan.
  • Georgia Tourassi
    Computational Sciences and Engineering Division, Health Data Sciences Institute, Oak Ridge National Laboratory, Oak Ridge, Tennessee, USA.
  • Daniel Vergara
    Department of Radiology, Yale New Haven Hospital, New Haven, Connecticut, USA.
  • Samuel G Armato
    From the Department of Radiology, The University of Chicago, 5841 S Maryland Ave, MC 2026, Chicago, IL 60637.