Clinical concept extraction using transformers.

Journal: Journal of the American Medical Informatics Association : JAMIA
Published Date:

Abstract

OBJECTIVE: The goal of this study is to explore transformer-based models (eg, Bidirectional Encoder Representations from Transformers [BERT]) for clinical concept extraction and develop an open-source package with pretrained clinical models to facilitate concept extraction and other downstream natural language processing (NLP) tasks in the medical domain.

Authors

  • Xi Yang
    Department of Health Outcomes and Biomedical Informatics.
  • Jiang Bian
    Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, United States of America.
  • William R Hogan
    Department of Health Outcomes and Biomedical Informatics.
  • Yonghui Wu
    Department of Health Outcomes and Biomedical Informatics.