Verity plots: A novel method of visualizing reliability assessments of artificial intelligence methods in quantitative cardiovascular magnetic resonance.

Journal: PloS one
PMID:

Abstract

BACKGROUND: Artificial intelligence (AI) methods have established themselves in cardiovascular magnetic resonance (CMR) as automated quantification tools for ventricular volumes, function, and myocardial tissue characterization. Quality assurance approaches focus on measuring and controlling AI-expert differences but there is a need for tools that better communicate reliability and agreement. This study introduces the Verity plot, a novel statistical visualization that communicates the reliability of quantitative parameters (QP) with clear agreement criteria and descriptive statistics.

Authors

  • Thomas Hadler
    Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Berlin, Germany.
  • Clemens Ammann
    Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Berlin, Germany.
  • Hadil Saad
    Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, ECRC Experimental and Clinical Research Center, Berlin, Germany.
  • Leonhard Grassow
    Klinik für Kardiologie, Angiologie und Intensivmedizin, Deutsches Herzzentrum der Charité (DHZC), Charitéplatz 1, 10117, Berlin, Deutschland.
  • Philine Reisdorf
    Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, ECRC Experimental and Clinical Research Center, Berlin, Germany.
  • Steffen Lange
    Department of Computer Sciences, Hochschule Darmstadt - University of Applied Sciences, Darmstadt, Germany.
  • Sascha Däuber
    Siemens Healthineers, Erlangen, Germany.
  • Jeanette Schulz-Menger
    Charité-Universitätsmedizin Berlin, Experimental and Clinical Research Center, Working Group On CMR and HELIOS Klinikum Berlin Buch, Cardiology Berlin, DZHK partnersite Berlin, Berlin, Germany.