ChatGPT as a patient education tool in colorectal cancer-An in-depth assessment of efficacy, quality and readability.

Journal: Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland
PMID:

Abstract

AIM: Artificial intelligence (AI) chatbots such as Chat Generative Pretrained Transformer-4 (ChatGPT-4) have made significant strides in generating human-like responses. Trained on an extensive corpus of medical literature, ChatGPT-4 has the potential to augment patient education materials. These chatbots may be beneficial to populations considering a diagnosis of colorectal cancer (CRC). However, the accuracy and quality of patient education materials are crucial for informed decision-making. Given workforce demands impacting holistic care, AI chatbots can bridge gaps in CRC information, reaching wider demographics and crossing language barriers. However, rigorous evaluation is essential to ensure accuracy, quality and readability. Therefore, this study aims to evaluate the efficacy, quality and readability of answers generated by ChatGPT-4 on CRC, utilizing patient-style question prompts.

Authors

  • Adrian H Y Siu
    Concord Institute of Academic Surgery (CIAS), Concord Repatriation General Hospital, Concord, New South Wales, Australia.
  • Damien P Gibson
    Surgical Outcomes Research Centre (SOuRCe), Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia.
  • Chris Chiu
    School of Medicine, The University of Sydney, Sydney, New South Wales, Australia.
  • Allan Kwok
    Department of Colorectal Surgery, Bankstown-Lidcombe Hospital, South Western Sydney Local Health District, Sydney, New South Wales, Australia.
  • Matt Irwin
    Department of Colorectal Surgery, Bankstown-Lidcombe Hospital, South Western Sydney Local Health District, Sydney, New South Wales, Australia.
  • Adam Christie
    Department of Colorectal Surgery, Bankstown-Lidcombe Hospital, South Western Sydney Local Health District, Sydney, New South Wales, Australia.
  • Cherry E Koh
    Faculty of Medicine and Health, Central Clinical School, The University of Sydney, Sydney, New South Wales, Australia.
  • Anil Keshava
    Concord Institute of Academic Surgery (CIAS), Concord Repatriation General Hospital, Concord, New South Wales, Australia.
  • Mifanwy Reece
    Concord Institute of Academic Surgery (CIAS), Concord Repatriation General Hospital, Concord, New South Wales, Australia.
  • Michael Suen
    Division of Colorectal Surgery, Department of Surgery, Concord Repatriation General Hospital, Sydney, New South Wales, Australia.
  • Matthew J F X Rickard
    Concord Institute of Academic Surgery (CIAS), Concord Repatriation General Hospital, Concord, New South Wales, Australia.