AIMC Topic: Educational Measurement

Clear Filters Showing 171 to 180 of 311 articles

Performance of three artificial intelligence (AI)-based large language models in standardized testing; implications for AI-assisted dental education.

Journal of periodontal research
INTRODUCTION: The emerging rise in novel computer technologies and automated data analytics has the potential to change the course of dental education. In line with our long-term goal of harnessing the power of AI to augment didactic teaching, the ob...

The conversational AI "ChatGPT" outperforms medical students on a physiology university examination.

Advances in physiology education
Artificial intelligence (AI) has gained massive interest with the public release of the conversational AI "ChatGPT," but it also has become a matter of concern for academia as it can easily be misused. We performed a quantitative evaluation of the pe...

Comparative accuracy of ChatGPT-4, Microsoft Copilot and Google Gemini in the Italian entrance test for healthcare sciences degrees: a cross-sectional study.

BMC medical education
BACKGROUND: Artificial intelligence (AI) chatbots are emerging educational tools for students in healthcare science. However, assessing their accuracy is essential prior to adoption in educational settings. This study aimed to assess the accuracy of ...

A real-world test of artificial intelligence infiltration of a university examinations system: A "Turing Test" case study.

PloS one
The recent rise in artificial intelligence systems, such as ChatGPT, poses a fundamental problem for the educational sector. In universities and schools, many forms of assessment, such as coursework, are completed without invigilation. Therefore, stu...

Performance of large language models in oral and maxillofacial surgery examinations.

International journal of oral and maxillofacial surgery
This study aimed to determine the accuracy of large language models (LLMs) in answering oral and maxillofacial surgery (OMS) multiple choice questions. A total of 259 questions from the university's question bank were answered by the LLMs (GPT-3.5, G...

The Impact of an Artificial Intelligence Certificate Program on Radiology Resident Education.

Academic radiology
RATIONALE AND OBJECTIVES: The objective of this study was to evaluate the effectiveness of a pilot artificial intelligence (AI) certificate program in aiding radiology trainees to develop an understanding of the evolving role and application of artif...

Exploring the Use of Natural Language Processing to Understand Emotions of Trainees and Faculty Regarding Entrustable Professional Activity Assessments.

Journal of graduate medical education
In medical education, artificial intelligence techniques such as natural language processing (NLP) are starting to be used to capture and analyze emotions through written text. To explore the application of NLP techniques to understand resident and...

The Surgical Clerkship in the COVID Era: A Natural Language Processing and Thematic Analysis.

The Journal of surgical research
INTRODUCTION: Responses to COVID-19 within medical education prompted significant changes to the surgical clerkship. We analyzed the changes in medical student end of course feedback before and after the COVID-19 outbreak.

Assessing ChatGPT 4.0's test performance and clinical diagnostic accuracy on USMLE STEP 2 CK and clinical case reports.

Scientific reports
While there is data assessing the test performance of artificial intelligence (AI) chatbots, including the Generative Pre-trained Transformer 4.0 (GPT 4) chatbot (ChatGPT 4.0), there is scarce data on its diagnostic accuracy of clinical cases. We ass...

Learning with AI Language Models: Guidelines for the Development and Scoring of Medical Questions for Higher Education.

Journal of medical systems
In medical and biomedical education, traditional teaching methods often struggle to engage students and promote critical thinking. The use of AI language models has the potential to transform teaching and learning practices by offering an innovative,...