Accuracy and consistency of publicly available Large Language Models as clinical decision support tools for the management of colon cancer.

Journal: Journal of surgical oncology
Published Date: Aug 19, 2024

Abstract

BACKGROUND: Large Language Models (LLM; e.g., ChatGPT) may be used to assist clinicians and form the basis of future clinical decision support (CDS) for colon cancer. The objectives of this study were to (1) evaluate the response accuracy of two LLM-powered interfaces in identifying guideline-based care in simulated clinical scenarios and (2) define response variation between and within LLMs.

Authors

  • Kristen N Kaiser
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN. Electronic address: https://twitter.com/kristen_kaiser1.
  • Alexa J Hughes
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN.
  • Anthony D Yang
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN.
  • Anita A Turk
    Department of Medicine, Division of Hematology & Oncology, Indiana University School of Medicine, Indianapolis, Indiana, USA.
  • Sanjay Mohanty
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN.
  • Andrew A Gonzalez
    Regenstrief Institute Center for Health Services Research and Indiana University School of Medicine.
  • Rachel E Patzer
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Center for Health Services Research, Regienstrief Institute, Indianapolis, IN.
  • Karl Y Bilimoria
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN.
  • Ryan J Ellis
    Surgical Outcomes and Quality Improvement Center (SOQIC), Department of Surgery, Indiana School of Medicine, Indianapolis, IN; Department of Surgery, Division of Surgical Oncology, Indiana University School of Medicine, Indianapolis, IN. Electronic address: ellisrj@iu.edu.

Keywords

External Resources

Popular Topics
Recent Journals