Recommendations for Reporting Machine Learning Analyses in Clinical Research.

Journal: Circulation. Cardiovascular quality and outcomes
PMID:

Abstract

Use of machine learning (ML) in clinical research is growing steadily given the increasing availability of complex clinical data sets. ML presents important advantages in terms of predictive performance and identifying undiscovered subpopulations of patients with specific physiology and prognoses. Despite this popularity, many clinicians and researchers are not yet familiar with evaluating and interpreting ML analyses. Consequently, readers and peer-reviewers alike may either overestimate or underestimate the validity and credibility of an ML-based model. Conversely, ML experts without clinical experience may present details of the analysis that are too granular for a clinical readership to assess. Overwhelming evidence has shown poor reproducibility and reporting of ML models in clinical research suggesting the need for ML analyses to be presented in a clear, concise, and comprehensible manner to facilitate understanding and critical evaluation. We present a recommendation for transparent and structured reporting of ML analysis results specifically directed at clinical researchers. Furthermore, we provide a list of key reporting elements with examples that can be used as a template when preparing and submitting ML-based manuscripts for the same audience.

Authors

  • Laura M Stevens
    Division of Cardiology, University of Colorado School of Medicine, Aurora, CO (L.M.S., D.P.K.).
  • Bobak J Mortazavi
    Texas A&M University, USA.
  • Rahul C Deo
    From the Division of Cardiology, Department of Medicine; Cardiovascular Research Institute; Institute for Human Genetics; and Institute for Computational Health Sciences, University of California San Francisco, and California Institute for Quantitative Biosciences (R.C.D.); and VA Health Services Research and Development Center for Clinical Management Research, VA Ann Arbor Healthcare System, MI; Michigan Center for Health Analytics and Medical Prediction (M-CHAMP), Department of Internal Medicine, University of Michigan Medical School, Ann Arbor (B.K.N.). rahul.deo@ucsf.edu.
  • Lesley Curtis
    Department of Population Health Sciences and Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC (L.C.).
  • David P Kao
    Division of Cardiology, Department of Medicine, University of Colorado School of Medicine, Aurora, CO.