AI-assisted script concordance tests: Enhancing feasibility with customized ChatGPT.
Journal:
Medical teacher
Published Date:
Jul 24, 2025
Abstract
WHAT WAS THE EDUCATIONAL CHALLENGE?: The Script Concordance Test (SCT) assesses clinical reasoning by evaluating responses to uncertain scenarios against expert clinician panels. Unlike traditional multiple-choice questions (MCQs), SCTs measure how examinees structure their knowledge in complex, evolving contexts. Grounded in script theory, SCTs capture the cognitive networks clinicians develop through experience, allowing assessment of real-world decision-making. Developing SCTs presents challenges, including crafting clinically relevant scenarios with appropriate ambiguity and ensuring expert panel reliability. Scoring depends on concordance with expert panels, requiring careful recruitment of 15-20 experts for validity. These logistical demands complicate SCT implementation, particularly in high-stakes assessments.
Authors
Keywords
No keywords available for this article.
