Reducing variability of breast cancer subtype predictors by grounding deep learning models in prior knowledge.

Journal: Computers in biology and medicine
Published Date:

Abstract

Deep learning neural networks have improved performance in many cancer informatics problems, including breast cancer subtype classification. However, many networks experience underspecificationwheremultiplecombinationsofparametersachievesimilarperformance, bothin training and validation. Additionally, certain parameter combinations may perform poorly when the test distribution differs from the training distribution. Embedding prior knowledge from the literature may address this issue by boosting predictive models that provide crucial, in-depth information about a given disease. Breast cancer research provides a wealth of such knowledge, particularly in the form of subtype biomarkers and genetic signatures. In this study, we draw on past research on breast cancer subtype biomarkers, label propagation, and neural graph machines to present a novel methodology for embedding knowledge into machine learning systems. We embed prior knowledge into the loss function in the form of inter-subject distances derived from a well-known published breast cancer signature. Our results show that this methodology reduces predictor variability on state-of-the-art deep learning architectures and increases predictor consistency leading to improved interpretation. We find that pathway enrichment analysis is more consistent after embedding knowledge. This novel method applies to a broad range of existing studies and predictive models. Our method moves the traditional synthesis of predictive models from an arbitrary assignment of weights to genes toward a more biologically meaningful approach of incorporating knowledge.

Authors

  • Paul Anderson
    Department of Computer Science and Software Engineering, California Polytechnic State University, San Luis Obispo, CA, USA.
  • Richa Gadgil
    Department of Computer Science and Software Engineering, California Polytechnic State University, San Luis Obispo, CA, USA.
  • William A Johnson
    Department of Biology, California Polytechnic State University, San Luis Obispo, CA, USA.
  • Ella Schwab
    Department of Biology, California Polytechnic State University, San Luis Obispo, CA, USA.
  • Jean M Davidson
    Department of Genetics, Stanford University School of Medicine, Stanford, CA 94305, USA and Center for Biomolecular Science and Engineering, School of Engineering, University of California Santa Cruz, Santa Cruz, CA 95064, USA.