Predicting Drug-Side Effect Relationships From Parametric Knowledge Embedded in Biomedical BERT Models: Methodological Study With a Natural Language Processing Approach.

Journal: JMIR medical informatics
Published Date:

Abstract

BACKGROUND: Adverse drug reactions (ADRs) pose serious risks to patient health, and effectively predicting and managing them is an important public health challenge. Given the complexity and specificity of biomedical text data, the traditional context-independent word embedding model, Word2Vec, has limitations in fully reflecting the domain specificity of such data. Although Bidirectional Encoder Representations from Transformers (BERT)-based models pretrained on biomedical corpora have demonstrated high performance in ADR-related studies, research using these models to predict previously unknown drug-side effect relationships remains insufficient.

Authors

  • Woohyuk Jeon
    Department of Computer Engineering, College of IT Convergence, Gachon University, AI·Engineering Building, 317A, 1342 Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Seongnam, 13120, Republic of Korea, 82 010-9012-9364, 82 031-750-5333.
  • Minjae Park
    Department of Electronic Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea.
  • Doyeon An
    Department of Computer Engineering, College of IT Convergence, Gachon University, AI·Engineering Building, 317A, 1342 Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Seongnam, 13120, Republic of Korea, 82 010-9012-9364, 82 031-750-5333.
  • Wonshik Nam
    Department of Computer Engineering, College of IT Convergence, Gachon University, AI·Engineering Building, 317A, 1342 Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Seongnam, 13120, Republic of Korea, 82 010-9012-9364, 82 031-750-5333.
  • Ju-Young Shin
    Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon, Republic of Korea. shin.jy@skku.edu.
  • Seunghee Lee
    Health Care Data Science Center, Konyang University Hospital, Daejeon, Republic of Korea.
  • Suehyun Lee
    Health Care Data Science Center, Konyang University Hospital, Daejeon, Republic of Korea. shleemedi@kyuh.ac.kr.