Deep Learning for Genomics: From Early Neural Nets to Modern Large Language Models.

Journal: International journal of molecular sciences
PMID:

Abstract

The data explosion driven by advancements in genomic research, such as high-throughput sequencing techniques, is constantly challenging conventional methods used in genomics. In parallel with the urgent demand for robust algorithms, deep learning has succeeded in various fields such as vision, speech, and text processing. Yet genomics entails unique challenges to deep learning, since we expect a superhuman intelligence that explores beyond our knowledge to interpret the genome from deep learning. A powerful deep learning model should rely on the insightful utilization of task-specific knowledge. In this paper, we briefly discuss the strengths of different deep learning models from a genomic perspective so as to fit each particular task with proper deep learning-based architecture, and we remark on practical considerations of developing deep learning architectures for genomics. We also provide a concise review of deep learning applications in various aspects of genomic research and point out current challenges and potential research directions for future genomics applications. We believe the collaborative use of ever-growing diverse data and the fast iteration of deep learning models will continue to contribute to the future of genomics.

Authors

  • Tianwei Yue
    School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
  • Yuanxin Wang
  • Longxiang Zhang
    School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
  • Chunming Gu
    Department of Biomedical Engineering, School of Medicine, Johns Hopkins University, Baltimore, MD 21218, USA.
  • Haoru Xue
    The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
  • Wenping Wang
    School of Management Science and Engineering, Shandong Normal University, Jinan, China.
  • Qi Lyu
    Department of Computational Mathematics, Science, and Engineering, Michigan State University, East Lansing, MI 48824, USA.
  • Yujie Dun
    School of Information and Communications Engineering, Xi'an Jiaotong University, Xi'an 710049, China.