Robust evaluation of deep learning-based representation methods for survival and gene essentiality prediction on bulk RNA-seq data.

Journal: Scientific reports
PMID:

Abstract

Deep learning (DL) has shown potential to provide powerful representations of bulk RNA-seq data in cancer research. However, there is no consensus regarding the impact of design choices of DL approaches on the performance of the learned representation, including the model architecture, the training methodology and the various hyperparameters. To address this problem, we evaluate the performance of various design choices of DL representation learning methods using TCGA and DepMap pan-cancer datasets and assess their predictive power for survival and gene essentiality predictions. We demonstrate that baseline methods achieve comparable or superior performance compared to more complex models on survival predictions tasks. DL representation methods, however, are the most efficient to predict the gene essentiality of cell lines. We show that auto-encoders (AE) are consistently improved by techniques such as masking and multi-head training. Our results suggest that the impact of DL representations and of pretraining are highly task- and architecture-dependent, highlighting the need for adopting rigorous evaluation guidelines. These guidelines for robust evaluation are implemented in a pipeline made available to the research community.

Authors

  • Baptiste Gross
    Owkin, Inc., New York, NY, USA. baptiste.gross@owkin.com.
  • Antonin Dauvin
    Owkin, Inc., New York, NY, USA.
  • Vincent Cabeli
    Owkin, Inc., New York, NY, USA.
  • Virgilio Kmetzsch
    Owkin, Inc., New York, NY, USA.
  • Jean El Khoury
    Owkin, Inc., New York, NY, USA.
  • Gaëtan Dissez
    Owkin, Inc., New York, NY, USA.
  • Khalil Ouardini
    Owkin, Inc., New York, NY, USA.
  • Simon Grouard
    Owkin, Inc., New York, NY, USA.
  • Alec Davi
    Owkin, Inc., New York, NY, USA.
  • Regis Loeb
    Owkin, Inc., New York, NY, USA.
  • Christian Esposito
    Owkin, Inc., New York, NY, USA.
  • Louis Hulot
    Owkin, Inc., New York, NY, USA.
  • Ridouane Ghermi
    Owkin Lab, Owkin, Inc., 10003, New York, NY, USA.
  • Michael Blum
    Center for Digital Health Innovation, University of California, San Francisco, San Francisco, CA, USA.
  • Yannis Darhi
    Owkin, Inc., New York, NY, USA.
  • Eric Y Durand
    NIBR, Oncology, Novartis Institutes for BioMedical Research Inc, 4056 Basel, Switzerland.
  • Alberto Romagnoni
    Centre de recherche sur l'inflammation UMR 1149, Inserm - Université Paris Diderot, 75018, Paris, France.