Comparison of quality, empathy and readability of physician responses versus chatbot responses to common cerebrovascular neurosurgical questions on a social media platform.

Journal: Clinical neurology and neurosurgery
Published Date:

Abstract

BACKGROUND: Social media platforms are utilized by patients prior to scheduling formal consultations and also serve as a means of pursuing second opinions. Cerebrovascular pathologies require regular surveillance and specialized care. In recent years, chatbots have been trained to provide information on neurosurgical conditions. However, their ability to answer questions in vascular neurosurgery have not been evaluated in comparison to physician responses. Our study is a pilot study evaluating the accuracy, completeness, empathy, and readability of responses provided by ChatGPT 3.5 (Open AI, San Francisco) to standard specialist physician responses on social media.

Authors

  • Joanna M Roy
    Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA.
  • Elias Atallah
    Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA.
  • Keenan Piper
    Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA.
  • Shyam Majmundar
    Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA.
  • Nikolaos Mouchtouris
    Department of Neurosurgery, Thomas Jefferson University Hospitals, Philadelphia, Pennsylvania.
  • D Mitchell Self
    Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA.
  • Anand Kaul
    Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA.
  • Saman Sizdahkhani
    Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA.
  • Basel Musmar
    School of Medicine, An-Najah National University, Nablus, Palestine.
  • Stavropoula I Tjoumakaris
    Department of Neurological Surgery, Thomas Jefferson University Hospital, 901 Walnut Street 3rd Floor, Philadelphia, PA 19107, USA.
  • Michael R Gooch
    Department of Neurological Surgery, Thomas Jefferson University Hospital, 901 Walnut Street 3rd Floor, Philadelphia, PA 19107, USA.
  • Robert H Rosenwasser
    Department of Neurosurgery, Thomas Jefferson University, Philadelphia, PA.
  • Pascal M Jabbour
    Department of Neurological Surgery, Thomas Jefferson University Hospital, 901 Walnut Street 3rd Floor, Philadelphia, PA 19107, USA. Electronic address: pascal.jabbour@jefferson.edu.