Quantifying the Scope of Artificial Intelligence-Assisted Writing in Orthopaedic Medical Literature: An Analysis of Prevalence and Validation of AI-Detection Software.

Journal: The Journal of the American Academy of Orthopaedic Surgeons
PMID:

Abstract

INTRODUCTION: The popularization of generative artificial intelligence (AI), including Chat Generative Pre-trained Transformer (ChatGPT), has raised concerns for the integrity of academic literature. This study asked the following questions: (1) Has the popularization of publicly available generative AI, such as ChatGPT, increased the prevalence of AI-generated orthopaedic literature? (2) Can AI detectors accurately identify ChatGPT-generated text? (3) Are there associations between article characteristics and the likelihood that it was AI generated?

Authors

  • Joshua R Porto
    From the Department of Orthopaedic Surgery, University Hospitals of Cleveland, Case Western Reserve University, Cleveland, OH (Porto, Morgan, Hecht, Burkhart, and Liu), and the Case Western Reserve University School of Medicine, Cleveland, OH (Porto, Morgan, and Hecht).
  • Kerry A Morgan
  • Christian J Hecht
    Department of Orthopaedic Surgery, Cleveland Clinic Foundation, 9500 Euclid Ave, Cleveland, OH, 44195, USA.
  • Robert J Burkhart
  • Raymond W Liu