AIMC Topic: Educational Measurement

Clear Filters Showing 11 to 20 of 311 articles

Performance of large language models in non-English medical ethics-related multiple choice questions: comparison of ChatGPT performance across versions and languages.

BMC medical ethics
BACKGROUND: As large language models (LLMs) evolve, assessing their competence in ethically sensitive domains such as medical ethics has become increasingly important. Since medical ethics is a universal component of medical education, disparities in...

The Validity of Generative Artificial Intelligence in Evaluating Medical Students in Objective Structured Clinical Examination: Experimental Study.

JMIR formative research
BACKGROUND: The Objective Structured Clinical Examination (OSCE) has been widely used to evaluate students in medical education. However, it is resource-intensive, presenting challenges in implementation. We hypothesized that generative artificial in...

Artificial intelligence based personalized student feedback system -Sisu Athwala' to enhance exam performance of medical undergraduates.

PloS one
BACKGROUND: In medical education, mentoring and feedback play crucial roles. Providing feedback on exam performance is a vital component as it allows students to improve. Feedback has to be tailor made and specific to the individual student. This nee...

Feasibility of a Specialized Large Language Model for Postgraduate Medical Examination Preparation: Single-Center Proof-Of-Concept Study.

JMIR formative research
BACKGROUND: Large language models (LLMs) are increasingly used in medical education for feedback and grading; yet their role in postgraduate examination preparation remains uncertain due to inconsistent grading, hallucinations, and user acceptance.

When AI models take the exam: large language models vs medical students on multiple-choice course exams.

Medical education online
Large language models (LLMs) are increasingly used in healthcare and medical education, but their performance on institution-authored multiple-choice questions (MCQs), particularly with negative marking, remains unclear. To compare the examination pe...

Evaluation of AI models for radiology exam preparation: DeepSeek vs. ChatGPT-3.5.

Medical education online
The rapid advancement of artificial intelligence (AI) chatbots has generated significant interest regarding their potential applications within medical education. This study sought to assess the performance of the open-source large language model Dee...

Comparison of ChatGPT and DeepSeek on a Standardized Audiologist Qualification Examination in Chinese: Observational Study.

JMIR formative research
BACKGROUND: Generative artificial intelligence (GenAI), exemplified by ChatGPT and DeepSeek, is rapidly advancing and reshaping human-computer interaction with its growing reasoning capabilities and broad applications across fields such as medicine a...

Knowledge-level comparison in pulpal and periapical diseases: dental students versus artificial intelligence models (Gemini, Microsoft Copilot, ChatGPT-3.5, ChatGPT-4o): cross-sectional study.

BMC medical education
BACKGROUND: This study explored the diagnostic accuracy of artificial intelligence (AI) chatbots and dental students when responding to questions related to pulpal and periapical diseases. Rapid advancements in AI have led to increased interest in th...

A research roadmap for AI opportunities in student assessment for medical education.

BMC medical education
The integration of Artificial Intelligence (AI) in medical education is rapidly transforming assessment practices, offering unprecedented opportunities to enhance student evaluation, feedback, and learning pathways. However, despite the potential, a ...

Early detection of at-risk health sciences students: a machine learning-based predictive study using midterm grades.

BMC medical education
BACKGROUND: Early identification of students at academic risk is critical in health sciences education, particularly in regions prioritizing healthcare workforce development. This study evaluated the application of established machine learning (ML) c...