A benchmark for neural network robustness in skin cancer classification.

Journal: European journal of cancer (Oxford, England : 1990)
Published Date:

Abstract

BACKGROUND: One prominent application for deep learning-based classifiers is skin cancer classification on dermoscopic images. However, classifier evaluation is often limited to holdout data which can mask common shortcomings such as susceptibility to confounding factors. To increase clinical applicability, it is necessary to thoroughly evaluate such classifiers on out-of-distribution (OOD) data.

Authors

  • Roman C Maron
    National Center for Tumor Diseases, German Cancer Research Center, Heidelberg, Germany.
  • Justin G Schlager
    Department of Dermatology and Allergology, Ludwig Maximilian University of Munich, Munich, Germany.
  • Sarah Haggenmüller
    Digital Biomarkers for Oncology Group, National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Christof von Kalle
    National Center for Tumor Diseases, Department of Translational Oncology, German Cancer Research Center, Heidelberg, Germany.
  • Jochen S Utikal
    Department of Dermatology, Heidelberg University, Mannheim, Germany; Skin Cancer Unit, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Friedegund Meier
    Skin Cancer Center at the University Cancer Centre and National Center for Tumor Diseases Dresden, Department of Dermatology, University Hospital Carl Gustav Carus, Technische Universität Dresden, Germany.
  • Frank F Gellrich
    Skin Cancer Center at the University Cancer Centre and National Center for Tumor Diseases Dresden, Department of Dermatology, University Hospital Carl Gustav Carus, Technische Universität Dresden, Germany.
  • Sarah Hobelsberger
    Skin Cancer Center at the University Cancer Centre and National Center for Tumor Diseases Dresden, Department of Dermatology, University Hospital Carl Gustav Carus, Technische Universität, Dresden, Germany.
  • Axel Hauschild
    Department of Dermatology, University Hospital Kiel, Kiel, Germany.
  • Lars French
    Department of Dermatology and Allergology, Ludwig Maximilian University of Munich, Munich, Germany.
  • Lucie Heinzerling
    Department of Dermatology and Allergy, University Hospital, Ludwig Maximilian University of Munich, 80337 Munich, Germany.
  • Max Schlaak
    Department of Dermatology, Venereology and Allergology, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, 10117 Berlin, Germany.
  • Kamran Ghoreschi
    Department of Dermatology, Venereology and Allergology, Charité - Universitätsmedizin Berlin, Berlin, Germany.
  • Franz J Hilke
    Department of Dermatology, Venereology and Allergology, Charité - Universitätsmedizin Berlin, Berlin, Germany.
  • Gabriela Poch
    Department of Dermatology, Venereology and Allergology, Charité - Universitätsmedizin Berlin, Berlin, Germany.
  • Markus V Heppt
    Department of Dermatology, University Hospital Erlangen, University of Erlangen, Erlangen, Germany.
  • Carola Berking
    Department of Dermatology, University Hospital Munich, Ludwig Maximilian University of Munich, Munich, Germany.
  • Sebastian Haferkamp
    Department of Dermatology, University Hospital Regensburg, Regensburg, Germany.
  • Wiebke Sondermann
    Department of Dermatology, University Hospital Essen, Essen, Germany.
  • Dirk Schadendorf
    Department of Dermatology, University Hospital Essen, 45147 Essen, Germany.
  • Bastian Schilling
    Department of Dermatology, University Hospital Wuerzburg, Wuerzburg, Germany.
  • Matthias Goebeler
    Department of Dermatology, University Hospital Würzburg, Würzburg, Germany.
  • Eva Krieghoff-Henning
    Digital Biomarkers for Oncology Group (DBO), National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Achim Hekler
    National Center for Tumor Diseases, Department of Translational Oncology, German Cancer Research Center, Heidelberg, Germany.
  • Stefan Fröhling
    National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Im Neuenheimer Feld 460, 69120 Heidelberg, Germany.
  • Daniel B Lipka
    National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Jakob N Kather
    Department of Gastroenterology, University Hospital RWTH Aachen, Aachen, Germany. jakob.kather@gmail.com.
  • Titus J Brinker
    National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany.