Student Behavior Analysis using YOLOv5 and OpenPose in Smart Classroom Environment.
Journal:
AMIA ... Annual Symposium proceedings. AMIA Symposium
Published Date:
May 22, 2025
Abstract
In the classroom, artificial intelligence techniques help automate student behavior analysis, and teachers are able to understand students' class status more effectively. We developed an intelligent method for classroom behavior analysis by building a CQStu datasets and annotating 6,687 images through active learning. OpenPose was used to detect the key points of the student's body, and the key points of the key parts of the body were utilized to generate representative points of the student, and the idea of coordinates was used to assign the student's position. Using YOLOV5 to recognize students' classroom behaviors and count the number of times, our experimental results show that the average classroom behavior recognition accuracy is 84.23%, and the overall location accuracy is about 79.6%. In addition, we introduced a nonlinear weighting factor to evaluate the effectiveness of teaching and constructed corresponding classroom behavior weights based on different classroom scenarios. A method for student classroom behavior identification and analysis is provided, and a framework for future intelligent classroom teaching evaluation methods is established, providing objective data support for student performance analysis.