Use of large language models as clinical decision support tools for management pancreatic adenocarcinoma using National Comprehensive Cancer Network guidelines.

Journal: Surgery
Published Date: Mar 6, 2025

Abstract

BACKGROUND: Large language models may form the basis of clinical decision support tools to improve rates of guideline concordant care for pancreatic ductal adenocarcinoma. The objectives of this study were to 1) define the first-pass accuracy of 2 publicly available large language models in responding to prompts on the basis of National Comprehensive Cancer Network guidelines for pancreatic ductal adenocarcinoma, 2) describe consistency of responses within each large language models, and 3) explore differences between the 2 large language models in their accuracy and verbosity.

Authors

  • Kristen N Kaiser
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN. Electronic address: https://twitter.com/kristen_kaiser1.
  • Alexa J Hughes
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN.
  • Anthony D Yang
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN.
  • Sanjay Mohanty
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN.
  • Thomas K Maatman
    Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN.
  • Andrew A Gonzalez
    Regenstrief Institute Center for Health Services Research and Indiana University School of Medicine.
  • Rachel E Patzer
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Center for Health Services Research, Regienstrief Institute, Indianapolis, IN.
  • Karl Y Bilimoria
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN.
  • Ryan J Ellis
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN. Electronic address: ellisrj@iu.edu.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals