Sensitivity and Specificity of Using GPT-3.5 Turbo Models for Title and Abstract Screening in Systematic Reviews and Meta-analyses.

Journal: Annals of internal medicine
Published Date:

Abstract

BACKGROUND: Systematic reviews are performed manually despite the exponential growth of scientific literature.

Authors

  • Viet-Thi Tran
    Université Paris Cité and Université Sorbonne Paris Nord, Inserm, INRAe, Centre for Research in Epidemiology and Statistics (CRESS), Paris; and Centre d'Epidémiologie Clinique, Hôpital Hôtel-Dieu, AP-HP, Paris, France (V.-T.T.).
  • Gerald Gartlehner
    RTI International-University of North Carolina Evidence-based Practice Center, Research Triangle Park, NC, USA. ggartlehner@rti.org.
  • Sally Yaacoub
    Université Paris Cité and Université Sorbonne Paris Nord, Inserm, INRAe, Centre for Research in Epidemiology and Statistics (CRESS), Paris, France (S.Y., F.A.).
  • Isabelle Boutron
    Université Paris Cité and Université Sorbonne Paris Nord, Inserm, INRAe, Centre for Research in Epidemiology and Statistics (CRESS), Paris, France; and Centre d'Epidémiologie Clinique, Hôpital Hôtel-Dieu, AP-HP, Paris, France (I.B.).
  • Lukas Schwingshackl
    Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany (L.S., J.S., J.M.).
  • Julia Stadelmaier
    Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany (L.S., J.S., J.M.).
  • Isolde Sommer
    Department for Evidence-based Medicine and Evaluation, University for Continuing Education Krems, Krems, Austria (I.S.).
  • Farzaneh Alebouyeh
    Université Paris Cité and Université Sorbonne Paris Nord, Inserm, INRAe, Centre for Research in Epidemiology and Statistics (CRESS), Paris, France (S.Y., F.A.).
  • Sivem Afach
    Epidemiology in Dermatology and Evaluation of Therapeutics (EpiDermE)-EA 7379, University Paris Est Créteil Val de Marne, Créteil, France (S.A.).
  • Joerg Meerpohl
    Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany (L.S., J.S., J.M.).
  • Philippe Ravaud
    U1153, Epidemiology and Biostatistics Sorbonne Paris Cite Research Center (CRESS), Methods of therapeutic evaluation of chronic diseases team (METHODS), INSERM, Université Paris Descartes, Paris, Île-de-France, France.