Why does my medical AI look at pictures of birds? Exploring the efficacy of transfer learning across domain boundaries.

Journal: Computer methods and programs in biomedicine
Published Date:

Abstract

PURPOSE: In medical deep learning, models not trained from scratch are typically fine-tuned based on ImageNet-pretrained models. We posit that pretraining on data from the domain of the downstream task should almost always be preferable.

Authors

  • Frederic Jonske
    Computer Algorithms for Medicine Laboratory, Graz, Styria, Austria; Institute for AI in Medicine (IKIM), University Medicine Essen, Girardetstraße 2, 45131 Essen, Germany.
  • Moon Kim
    USDA-ARS Environmental Microbial and Food Safety Laboratory, Beltsville Agricultural Research Center, 10300 Baltimore Ave., Beltsville, MD 20705, USA.
  • Enrico Nasca
    Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany (Address: Institut für künstliche Intelligenz in der Medizin (IKIM), Girardetstr. 2 45131 Essen, NRW, Germany. Electronic address: enrico.nasca@uk-essen.de.
  • Janis Evers
    Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany (Address: Institut für künstliche Intelligenz in der Medizin (IKIM), Girardetstr. 2 45131 Essen, NRW, Germany. Electronic address: janis.evers@stud.uni-due.de.
  • Johannes Haubold
    Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Hufelandstraße 55, 45147, Essen, Germany. Johannes.haubold@uk-essen.de.
  • René Hosch
    Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Germany.
  • Felix Nensa
    Institute for AI in Medicine (IKIM), University Hospital Essen, 45131 Essen, Germany.
  • Michael Kamp
    Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany (Address: Institut für künstliche Intelligenz in der Medizin (IKIM), Girardetstr. 2 45131 Essen, NRW, Germany; Institute for Neuroinformatics, Ruhr University Bochum, Germany; Department of Data Science & AI, Monash University, Australia. Electronic address: michael.kamp@uk-essen.de.
  • Constantin Seibold
    Institute for AI in Medicine (IKIM), University Hospital Essen (AöR), 45131 Essen, Germany; Clinic for Nuclear Medicine, University Hospital Essen (AöR), 45147 Essen, Germany.
  • Jan Egger
    Institute for Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Graz, Austria.
  • Jens Kleesiek
    AG Computational Radiology, Abteilung Radiologie, Deutsches Krebsforschungszentrum (DKFZ), Im Neuenheimer Feld 280, 69120, Heidelberg, Deutschland. j.kleesiek@dkfz-heidelberg.de.