Large language models can accurately populate Vascular Quality Initiative procedural databases using narrative operative reports.

Journal: Journal of vascular surgery
PMID:

Abstract

OBJECTIVE: Participation in the Vascular Quality Initiative (VQI) provides important resources to surgeons, but the ability to do so is often limited by time and data entry personnel. Large language models (LLMs) such as ChatGPT (OpenAI) are examples of generative artificial intelligence products that may help bridge this gap. Trained on large volumes of data, the models are used for natural language processing and text generation. We evaluated the ability of LLMs to accurately populate VQI procedural databases using operative reports.

Authors

  • Colleen P Flanagan
    Division of Vascular and Endovascular Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA; Division of Clinical Informatics and Digital Transformation, Department of Medicine, University of California San Francisco, San Francisco, CA. Electronic address: Colleen.Flanagan@ucsf.edu.
  • Karen Trang
    Division of Clinical Informatics and Digital Transformation, Department of Medicine, University of California San Francisco, San Francisco, CA; Division of General Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA.
  • Joyce Nacario
    Division of Vascular and Endovascular Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA.
  • Peter A Schneider
    Division of Vascular and Endovascular Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA.
  • Warren J Gasper
    Division of Vascular and Endovascular Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA.
  • Michael S Conte
    Division of Vascular and Endovascular Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA.
  • Elizabeth C Wick
    Division of Clinical Informatics and Digital Transformation, Department of Medicine, University of California San Francisco, San Francisco, CA; Division of General Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA.
  • Allan M Conway
    Division of Vascular and Endovascular Surgery, Department of Surgery, University of California San Francisco, San Francisco, CA.