Comprehensive Drug-Likeness Prediction Using a Pretrained Transformer Model and Multitask Learning.

Journal: Journal of chemical information and modeling
Published Date:

Abstract

Drug-likeness is essential in drug discovery, indicating the potential of a compound to become a successful therapeutic. However, existing rule-based and machine learning methods are limited by their reliance on hand-crafted features, poor generalizability across chemical spaces, and insufficient adaptability to the diverse contexts of drug development. To overcome these limitations, we introduce an innovative framework that integrates molecular pretrained transformer models with multitask learning. This approach enables the simultaneous capture of complex chemical features and facilitates knowledge sharing across related prediction tasks. Our framework features two models: SpecDL, tailored for specialized drug-likeness assessments, and GeneralDL, designed for comprehensive, cross-data set evaluation. SpecDL achieved an average ROC-AUC of 0.836 across four tasks, while GeneralDL reached an average ROC-AUC of 0.781 on six internal and external test sets, both surpassing the leading existing methods. Furthermore, GeneralDL demonstrated robust generalization to toxicity and biological activity predictions and provided interpretable outputs via attention weight analysis. These results establish our framework as a powerful, generalizable tool for drug-likeness prediction with significant potential to enhance early-stage drug discovery.

Authors

  • Yi Cai
    College of Veterinary Medicine, Hebei Agricultural University, Baoding, Hebei 071000, China.
  • Qian Zhang
    The Neonatal Intensive Care Unit, Peking Union Medical College Hospital, Peking, China.
  • Wenchong Tan
    School of Biology and Biological Engineering, South China University of Technology, Guangzhou 510006, China.
  • Jing Li
    Department of Neurosurgery, Tianjin Medical University General Hospital, Tianjin, China.
  • Dong Chen
    School of Basic Medical Sciences, Health Science Center, Ningbo University, Ningbo, China.
  • Xiaoyun Lu
    College of Pharmacy, Jinan University, 601 Huangpu Avenue West, Guangzhou 510632, China. zhouyang@jnu.edu.cn.
  • Hongli Du
    School of Biology and Biological Engineering, South China University of Technology, Guangzhou 510006, China.