AtlasGPT: a language model grounded in neurosurgery with domain-specific data and document retrieval.

Journal: Journal of neurosurgery
Published Date:

Abstract

OBJECTIVE: Large language models (LLMs) have shown promising performance on medical licensing examinations, but their ability to excel in subspecialty domains and their robustness under adversarial conditions remain unclear. Herein, the authors present AtlasGPT, a subspecialty-focused LLM for neurosurgery, and evaluate its performance on a benchmark multiple-choice question bank and under adversarial testing, as well as its ability to generate high-quality explanations.

Authors

  • Rohaid Ali
    Departments of1Neurosurgery and.
  • Hael F Abdulrazeq
    Departments of1Neurosurgery and.
  • Advait Patil
    2Department of Neurosurgery, Harvard Medical School, Cambridge, Massachusetts.
  • Morgan Cheatham
    Departments of1Neurosurgery and.
  • Ian D Connolly
    2Department of Neurosurgery, Harvard Medical School, Cambridge, Massachusetts.
  • Oliver Y Tang
    3Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania.
  • Cody A Doberstein
    Departments of1Neurosurgery and.
  • Tori Riccelli
    Departments of1Neurosurgery and.
  • Kevin T Huang
    2Department of Neurosurgery, Harvard Medical School, Cambridge, Massachusetts.
  • Ganesh M Shankar
    2Department of Neurosurgery, Harvard Medical School, Cambridge, Massachusetts.
  • Theresa Williamson
    2Department of Neurosurgery, Harvard Medical School, Cambridge, Massachusetts.
  • John H Shin
    2Department of Neurosurgery, Harvard Medical School, Cambridge, Massachusetts.
  • Bob Carter
    2Department of Neurosurgery, Harvard Medical School, Cambridge, Massachusetts.
  • Radmehr Torabi
    Departments of1Neurosurgery and.
  • Christine K Lee
    Departments of1Neurosurgery and.
  • Deus Cielo
    Departments of1Neurosurgery and.
  • Albert E Telfeian
    Departments of1Neurosurgery and.
  • Ziya L Gokaslan
    Departments of1Neurosurgery and.
  • Aaron A Cohen-Gadol
    4Department of Neurosurgery, Indiana University, Indianapolis, Indiana; and.
  • James Zou
    Department of Biomedical Data Science, Stanford University, Stanford, California.
  • Wael F Asaad
    Departments of1Neurosurgery and.

Keywords

No keywords available for this article.