Integration of deep learning-based image analysis and genomic data in cancer pathology: A systematic review.

Journal: European journal of cancer (Oxford, England : 1990)
Published Date:

Abstract

BACKGROUND: Over the past decade, the development of molecular high-throughput methods (omics) increased rapidly and provided new insights for cancer research. In parallel, deep learning approaches revealed the enormous potential for medical image analysis, especially in digital pathology. Combining image and omics data with deep learning tools may enable the discovery of new cancer biomarkers and a more precise prediction of patient prognosis. This systematic review addresses different multimodal fusion methods of convolutional neural network-based image analyses with omics data, focussing on the impact of data combination on the classification performance.

Authors

  • Lucas Schneider
    Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Sara Laiouar-Pedari
    Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Sara Kuntz
    Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Eva Krieghoff-Henning
    Digital Biomarkers for Oncology Group (DBO), National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Achim Hekler
    National Center for Tumor Diseases, Department of Translational Oncology, German Cancer Research Center, Heidelberg, Germany.
  • Jakob N Kather
    Department of Gastroenterology, University Hospital RWTH Aachen, Aachen, Germany. jakob.kather@gmail.com.
  • Timo Gaiser
    Institute of Pathology, University Medical Center Mannheim, Mannheim, Germany.
  • Stefan Fröhling
    National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Im Neuenheimer Feld 460, 69120 Heidelberg, Germany.
  • Titus J Brinker
    National Center for Tumor Diseases (NCT), German Cancer Research Center (DKFZ), Heidelberg, Germany.