Comparative Analysis of NLP Models for Automatic LOINC Document Ontology Named Entity Recognition in Clinical Note Titles.

Journal: Studies in health technology and informatics
Published Date:

Abstract

In order to utilize clinical notes for research studies, it is necessary to identify the most relevant notes. Mapping to the LOINC Document Ontology makes this process easier by reducing the variability of note types. We experimented with three models to automatically identify LOINC DO entities in VA note titles. The supervised BERT model performed best, but the open-source large language models (LLMs) performed well despite a lack of fine-tuning. Future work will aim to improve note classification by including additional note metadata and contents, hybridizing with rule-based approaches, testing fine-tuned LLMs, and mapping to exact LOINC codes.

Authors

  • Annie E Bowles
    VA Salt Lake City Health Care System, 500, Foothill Boulevard, Salt Lake City 84148, USA; Division of Epidemiology, University of Utah, 295 Chipeta Way, Salt Lake City 84132, USA.
  • Qiwei Gan
    VA Salt Lake City Health Care System, 500, Foothill Boulevard, Salt Lake City 84148, USA; Division of Epidemiology, University of Utah, 295 Chipeta Way, Salt Lake City 84132, USA.
  • Elizabeth Hanchrow
    VA Salt Lake City Health Care System, Salt Lake City, UT, USA.
  • Scott Duvall
    VA Salt Lake City Health Care System.
  • Patrick R Alba
    VA Salt Lake City Health Care System.
  • Jianlin Shi
    University of Utah, Salt Lake City, UT, USA.