External validation of artificial intelligence for detection of heart failure with preserved ejection fraction.

Journal: Nature communications
PMID:

Abstract

Artificial intelligence (AI) models to identify heart failure (HF) with preserved ejection fraction (HFpEF) based on deep-learning of echocardiograms could help address under-recognition in clinical practice, but they require extensive validation, particularly in representative and complex clinical cohorts for which they could provide most value. In this study enrolling patients with HFpEF (cases; n = 240), and age, sex, and year of echocardiogram matched controls (n = 256), we compare the diagnostic performance (discrimination, calibration, classification, and clinical utility) and prognostic associations (mortality and HF hospitalization) between an updated AI HFpEF model (EchoGo Heart Failure v2) and existing clinical scores (H2FPEF and HFA-PEFF). The AI HFpEF model and H2FPEF score demonstrate similar discrimination and calibration, but classification is higher with AI than H2FPEF and HFA-PEFF, attributable to fewer intermediate scores, due to discordant multivariable inputs. The continuous AI HFpEF model output adds information beyond the H2FPEF, and integration with existing scores increases correct management decisions. Those with a diagnostic positive result from AI have a two-fold increased risk of the composite outcome. We conclude that integrating an AI HFpEF model into the existing clinical diagnostic pathway would improve identification of HFpEF in complex clinical cohorts, and patients at risk of adverse outcomes.

Authors

  • Ashley P Akerman
    Ultromics Ltd, Oxford, United Kingdom.
  • Nora Al-Roub
    Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
  • Constance Angell-James
    Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
  • Madeline A Cassidy
    Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
  • Rasheed Thompson
    Howard University College of Medicine, Washington, DC, USA.
  • Lorenzo Bosque
    Drexel University College of Medicine, Philadelphia, PA, USA.
  • Katharine Rainer
    Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
  • William Hawkes
    Ultromics Ltd, Oxford, United Kingdom.
  • Hania Piotrowska
    Ultromics Ltd, 4630 Kingsgate, Cascade Way, Oxford Business Park South, Oxford, OX4 2SU, UK.
  • Paul Leeson
    Ultromics Ltd, Oxford, United Kingdom.
  • Gary Woodward
    Ultromics Ltd, Oxford, United Kingdom.
  • Patricia A Pellikka
    Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota, USA.
  • Ross Upton
    Ultromics Ltd, Oxford, United Kingdom.
  • Jordan B Strom
    Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiology, Beth Israel Deaconess Medical Center, Boston, MA, USA. jstrom@bidmc.harvard.edu.