Language Models for Multilabel Document Classification of Surgical Concepts in Exploratory Laparotomy Operative Notes: Algorithm Development Study.

Journal: JMIR medical informatics
Published Date:

Abstract

BACKGROUND: Operative notes are frequently mined for surgical concepts in clinical care, research, quality improvement, and billing, often requiring hours of manual extraction. These notes are typically analyzed at the document level to determine the presence or absence of specific procedures or findings (eg, whether a hand-sewn anastomosis was performed or contamination occurred). Extracting several binary classification labels simultaneously is a multilabel classification problem. Traditional natural language processing approaches-bag-of-words (BoW) and term frequency-inverse document frequency (tf-idf) with linear classifiers-have been used previously for this task but are now being augmented or replaced by large language models (LLMs). However, few studies have examined their utility in surgery.

Authors

  • Jeremy A Balch
    Department of Surgery, University of Florida Health, Gainesville, FL, United States.
  • Sasank S Desaraju
    University of Florida College of Medicine, Gainesville, FL, United States.
  • Victoria J Nolan
    Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States.
  • Divya Vellanki
    University of Florida College of Medicine, Gainesville, FL, United States.
  • Timothy R Buchanan
    University of Florida College of Medicine, Gainesville, FL, United States.
  • Lindsey M Brinkley
    University of Florida College of Medicine, Gainesville, FL, United States.
  • Yordan Penev
    Department of Pediatrics, Stanford University, Palo Alto, CA, 94305, USA.
  • Ahmet Bilgili
    University of Florida College of Medicine, Gainesville, FL, United States.
  • Aashay Patel
    University of Florida College of Medicine, Gainesville, FL, United States.
  • Corinne E Chatham
    College of Medicine, University of Florida.
  • David M Vanderbilt
    University of Florida College of Medicine, Gainesville, FL, United States.
  • Rayon Uddin
    Intelligent Clinical Care Center, University of Florida, Gainesville, FL, USA.
  • Azra Bihorac
    Department of Medicine, University of Florida, Gainesville, FL USA.
  • Philip Efron
    Department of Surgery, University of Florida, Gainesville, FL; Department of Anesthesia, University of Florida, Gainesville, FL.
  • Tyler J Loftus
    Department of Surgery, University of Florida Health, Gainesville, FL. Electronic address: tyler.loftus@surgery.ufl.edu.
  • Protiva Rahman
    Vanderbilt University Medical Center, Nashville, TN.
  • Benjamin Shickel
    Department of Medicine, University of Florida, Gainesville, FL USA.