Evaluating the quality, understandability, actionability, and readability of ChatGPT-generated patient information on overactive bladder: A cross-sectional study.

Journal: Medicine
Published Date:

Abstract

This cross-sectional study aimed to evaluate the quality, understandability, actionability, and readability of patient-oriented information generated by ChatGPT regarding overactive bladder (OAB). A total of 32 frequently asked patient questions related to OAB were categorized into 6 domains, including general information, diagnosis, lifestyle and behavioral management, medical treatment, minimally invasive treatments, and surgical treatment, and submitted to ChatGPT-4o. The responses were evaluated independently by 2 researchers using the DISCERN instrument to assess information quality and the Patient Education Materials Assessment Tool - Printable version to evaluate understandability and actionability. Readability was assessed using the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook formulas. The overall mean DISCERN score was 51, indicating moderate information quality across categories. Patient Education Materials Assessment Tool analysis demonstrated relatively high understandability (81.8%) but limited actionability (45.5%). Readability analysis revealed that the responses exceeded recommended patient education standards, with overall median Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook scores of 14.00 (range: 7.61-17.11) and 12.34 (range: 5.01-14.93), respectively. Category-based analyses demonstrated variability across content domains, with treatment-related responses showing relatively higher information quality and lifestyle-related responses demonstrating greater actionability. Although ChatGPT-generated responses demonstrated moderate information quality and were generally understandable, limitations related to actionability and readability may restrict their practical use in patient education. These findings suggest that ChatGPT may serve as a supportive tool for patient education in OAB; however, it should be considered a complementary resource used under physician supervision rather than a substitute for clinical guidance.

Authors

Keywords

No keywords available for this article.