Can We Geographically Validate a Natural Language Processing Algorithm for Automated Detection of Incidental Durotomy Across Three Independent Cohorts From Two Continents?

Journal: Clinical orthopaedics and related research
Published Date: Apr 12, 2022

Abstract

BACKGROUND: Incidental durotomy is an intraoperative complication in spine surgery that can lead to postoperative complications, increased length of stay, and higher healthcare costs. Natural language processing (NLP) is an artificial intelligence method that assists in understanding free-text notes that may be useful in the automated surveillance of adverse events in orthopaedic surgery. A previously developed NLP algorithm is highly accurate in the detection of incidental durotomy on internal validation and external validation in an independent cohort from the same country. External validation in a cohort with linguistic differences is required to assess the transportability of the developed algorithm, referred to geographical validation. Ideally, the performance of a prediction model, the NLP algorithm, is constant across geographic regions to ensure reproducibility and model validity.

Authors

  • Aditya V Karhade
    Computational Neurosciences Outcomes Center, Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
  • Jacobien H F Oosterhoff
    Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;
  • Olivier Q Groot
    Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA 02114, USA.
  • Nicole Agaronnik
    Health Policy Research Center-Mongan Institute, Massachusetts General Hospital, Boston.
  • Jeffrey Ehresman
    Department of Neurosurgery, the Johns Hopkins University School of Medicine, Baltimore, MD, USA.
  • Michiel E R Bongers
    Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA 02114, USA.
  • Ruurd L Jaarsma
  • Santosh I Poonnoose
    Department of Neurosurgery, Flinders Medical Centre, Flinders University, Adelaide, Australia.
  • Daniel M Sciubba
    Department of Neurosurgery, The Johns Hopkins Hospital, 600 North Wolfe Street; Meyer Building, Room 7-109, Baltimore, MD 21287, USA. Electronic address: Dsciubb1@jhmi.edu.
  • Daniel G Tobert
    Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA 02114, USA.
  • Job N Doornberg
  • Joseph H Schwab
    Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA. Electronic address: jhschwab@mgh.harvard.edu.

Keywords

External Resources

Popular Topics
Recent Journals