APPRAISE-AI Tool for Quantitative Evaluation of AI Studies for Clinical Decision Support.

Journal: JAMA network open
PMID: 37747733

Abstract

IMPORTANCE: Artificial intelligence (AI) has gained considerable attention in health care, yet concerns have been raised around appropriate methods and fairness. Current AI reporting guidelines do not provide a means of quantifying overall quality of AI research, limiting their ability to compare models addressing the same clinical question.

Authors

  • Jethro C C Kwong
    Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
  • Adree Khondker
    Division of Urology, The Hospital for Sick Children, 555 University Avenue, Toronto, ON, M5G 1X8, Canada.
  • Katherine Lajkosz
    Department of Biostatistics, Princess Margaret Cancer Centre, Toronto, ON, Canada.
  • Matthew B A McDermott
  • Xavier Borrat Frigola
    Laboratory for Computational Physiology, Harvard-Massachusetts Institute of Technology Division of Health Sciences and Technology, Cambridge.
  • Melissa D McCradden
    Division of Neurosurgery (McCradden, Baba, Saha, Boparai, Fadaiefard, Cusimano), St. Michael's Hospital, Unity Health Toronto; Dalla Lana School of Public Health (Cusimano), University of Toronto, Toronto, Ont. injuryprevention@smh.ca.
  • Muhammad Mamdani
    Unity Health Toronto (Verma, Murray, Straus, Pou-Prom, Mamdani); Li Ka Shing Knowledge Institute of St. Michael's Hospital (Verma, Straus, Pou-Prom, Mamdani); Department of Medicine (Verma, Shojania, Straus, Mamdani) and Institute of Health Policy, Management, and Evaluation (Verma, Mamdani) and Department of Statistics (Murray), University of Toronto, Toronto, Ont.; University of Alberta (Greiner); Alberta Machine Intelligence Institute (Greiner), Edmonton, Alta.; Montreal Institute for Learning Algorithms (Cohen), Montréal, Que.; Centre for Quality Improvement and Patient Safety (Shojania), University of Toronto; Sunnybrook Health Sciences Centre (Shojania); Vector Institute (Ghassemi, Mamdani) and Department of Computer Science (Ghassemi); Leslie Dan Faculty of Pharmacy (Mamdani), University of Toronto, Toronto, Ont.; Department of Radiology, Stanford University (Cohen), Stanford, Calif. muhammad.mamdani@unityhealth.to amol.verma@mail.utoronto.ca.
  • Girish S Kulkarni
    Division of Urology, Department of Surgery, University of Toronto, Toronto, ON, Canada; Division of Urology, Department of Surgery, Princess Margaret Cancer Centre, University Health Network, Toronto, ON, Canada; Temerty Centre for AI Research and Education in Medicine, University of Toronto, Toronto, ON, Canada.
  • Alistair E W Johnson

Keywords

External Resources

Popular Topics
Recent Journals