Large language models outperform traditional structured data-based approaches in identifying immunosuppressed patients

Journal: medRxiv
Published Date:

Abstract

Identifying immunosuppressed patients using structured data can be challenging. Large language models effectively extract structured concepts from unstructured clinical text. Here we show that GPT-4o outperforms traditional approaches in identifying immunosuppressive conditions and medication use by processing hospital admission notes. We also demonstrate the extensibility of our approach in an external dataset. Cost-effective models like GPT-4o mini and Llama 3.1 also perform well, but not as well as GPT-4o.

Authors

  • Vijeeth Guggilla; Mengjia Kang; Melissa J Bak; Steven D Tran; Anna Pawlowski; Prasanth Nannapaneni; Luke V Rasmussen; Daniel Schneider; Helen Donnelly; Ankit Agrawal; David Liebovitz; Alexander V Misharin; GR Scott Budinger; Richard G Wunderink; Theresa L Walunas; Catherine A Gao