Artificial intelligence large language model ChatGPT: is it a trustworthy and reliable source of information for sarcoma patients?

Journal: Frontiers in public health
PMID:

Abstract

INTRODUCTION: Since its introduction in November 2022, the artificial intelligence large language model ChatGPT has taken the world by storm. Among other applications it can be used by patients as a source of information on diseases and their treatments. However, little is known about the quality of the sarcoma-related information ChatGPT provides. We therefore aimed at analyzing how sarcoma experts evaluate the quality of ChatGPT's responses on sarcoma-related inquiries and assess the bot's answers in specific evaluation metrics.

Authors

  • Marisa Valentini
    Department of Orthopaedics and Trauma, Medical University of Graz, Graz, Austria.
  • Joanna Szkandera
    Division of Oncology, Department of Internal Medicine, Medical University of Graz, Graz, Austria.
  • Maria Anna Smolle
    Department of Orthopaedics and Trauma, Medical University of Graz, Graz, Austria.
  • Susanne Scheipl
    Department of Orthopaedics and Trauma, Medical University of Graz, Graz, Austria.
  • Andreas Leithner
    Department of Orthopedic Surgery, Medical University of Graz, Graz, Austria.
  • Dimosthenis Andreou
    Department of Orthopaedics and Trauma, Medical University of Graz, Graz, Austria.