Evaluating the Portability of an NLP System for Processing Echocardiograms: A Retrospective, Multi-site Observational Study.

Journal: AMIA ... Annual Symposium proceedings. AMIA Symposium
PMID: 32308812

Abstract

While natural language processing (NLP) of unstructured clinical narratives holds the potential for patient care and clinical research, portability of NLP approaches across multiple sites remains a major challenge. This study investigated the portability of an NLP system developed initially at the Department of Veterans Affairs (VA) to extract 27 key cardiac concepts from free-text or semi-structured echocardiograms from three academic edical centers: Weill Cornell Medicine, Mayo Clinic and Northwestern Medicine. While the NLP system showed high precision and recall easurements for four target concepts (aortic valve regurgitation, left atrium size at end systole, mitral valve regurgitation, tricuspid valve regurgitation) across all sites, we found moderate or poor results for the remaining concepts and the NLP system performance varied between individual sites.

Authors

  • Prakash Adekkanattu
    Information Technologies and Services.
  • Guoqian Jiang
    Mayo Clinic College of Medicine, Rochester, MN, USA.
  • Yuan Luo
    Department of Preventive Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL 60611, USA.
  • Paul R Kingsbury
    Mayo Clinic, Rochester, MN.
  • Zhenxing Xu
    Department of Population Health Sciences, Weill Cornell Medical College, Cornell University, New York, NY 10065, USA.
  • Luke V Rasmussen
    Northwestern University, Feinberg School of Medicine, Chicago, IL, USA.
  • Jennifer A Pacheco
    Northwestern University, Feinberg School of Medicine, Chicago, IL, USA.
  • Richard C Kiefer
    Northwestern University, Chicago, IL.
  • Daniel J Stone
    Mayo Clinic, Rochester, MN.
  • Pascal S Brandt
    University of Washington, Seattle, WA.
  • Liang Yao
    Northwestern University, Chicago, IL.
  • Yizhen Zhong
    Northwestern University, Chicago, IL.
  • Yu Deng
    National Engineering Research Center for Cereal Fermentation and Food Biomanufacturing, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, People's Republic of China.
  • Fei Wang
    Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York, NY, United States.
  • Jessica S Ancker
    Weill Cornell Medicine, New York, NY.
  • Thomas R Campion
    Information Technologies and Services Department, Weill Cornell Medicine, New York, NY.
  • Jyotishman Pathak
    Department of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA.

Keywords

External Resources

Popular Topics
Recent Journals