Dermatologist-like explainable AI enhances melanoma diagnosis accuracy: eye-tracking study.

Journal: Nature communications
Published Date:

Abstract

Artificial intelligence (AI) systems substantially improve dermatologists' diagnostic accuracy for melanoma, with explainable AI (XAI) systems further enhancing their confidence and trust in AI-driven decisions. Despite these advancements, there remains a critical need for objective evaluation of how dermatologists engage with both AI and XAI tools. In this study, 76 dermatologists participate in a reader study, diagnosing 16 dermoscopic images of melanomas and nevi using an XAI system that provides detailed, domain-specific explanations, while eye-tracking technology assesses their interactions. Diagnostic performance is compared with that of a standard AI system lacking explanatory features. Here we show that XAI significantly improves dermatologists' diagnostic balanced accuracy by 2.8 percentage points compared to standard AI. Moreover, diagnostic disagreements with AI/XAI systems and complex lesions are associated with elevated cognitive load, as evidenced by increased ocular fixations. These insights have significant implications for the design of AI/XAI tools for visual tasks in dermatology and the broader development of XAI in medical diagnostics.

Authors

  • Tirtha Chanda
    Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Sarah Haggenmueller
    Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Tabea-Clara Bucher
    Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Tim Holland-Letz
    Department of Biostatistics, German Cancer Research Center, Heidelberg, Germany.
  • Harald Kittler
    ViDIR Group, Department of Dermatology, Medical University of Vienna, Vienna, Austria. Electronic address: harald.kittler@meduniwien.at.at.
  • Philipp Tschandl
    Department of Computing Science, Simon Fraser University, Burnaby, British Columbia, Canada.
  • Markus V Heppt
    Department of Dermatology, University Hospital Erlangen, University of Erlangen, Erlangen, Germany.
  • Carola Berking
    Department of Dermatology, University Hospital Munich, Ludwig Maximilian University of Munich, Munich, Germany.
  • Jochen S Utikal
    Department of Dermatology, Heidelberg University, Mannheim, Germany; Skin Cancer Unit, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Bastian Schilling
    Department of Dermatology, University Hospital Wuerzburg, Wuerzburg, Germany.
  • Claudia Buerger
    Department of Dermatology, Venereology and Allergology, University Hospital Frankfurt, Goethe-University Frankfurt, Frankfurt, Germany.
  • Cristian Navarrete-Dechent
    Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA; Department of Dermatology, Facultad de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
  • Matthias Goebeler
    Department of Dermatology, University Hospital Würzburg, Würzburg, Germany.
  • Jakob Nikolas Kather
    Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany.
  • Carolin V Schneider
    Department of Internal Medicine III, Gastroenterology, Metabolic Diseases and Intensive Care, University Hospital RWTH Aachen, Aachen, Germany.
  • Benjamin Durani
    Dres. Durani, Outpatient Clinic for Dermatology, Heidelberg, Germany.
  • Hendrike Durani
    Dres. Durani, Outpatient Clinic for Dermatology, Heidelberg, Germany.
  • Martin Jansen
    Dr. Martin Jansen, Outpatient Clinic for Dermatology, Heidelberg, Germany.
  • Juliane Wacker
    Dres. Wacker, Outpatient Clinic for Dermatology, Heidelberg, Germany.
  • Joerg Wacker
    Dres. Wacker, Outpatient Clinic for Dermatology, Heidelberg, Germany.
  • Titus J Brinker
    National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany.