GELT: A graph embeddings based lite-transformer for knowledge tracing.

Journal: PloS one
PMID:

Abstract

The development of intelligent education has led to the emergence of knowledge tracing as a fundamental task in the learning process. Traditionally, the knowledge state of each student has been determined by assessing their performance in previous learning activities. In recent years, Deep Learning approaches have shown promising results in capturing complex representations of human learning activities. However, the interpretability of these models is often compromised due to the end-to-end training strategy they employ. To address this challenge, we draw inspiration from advancements in graph neural networks and propose a novel model called GELT (Graph Embeddings based Lite-Transformer). The purpose of this model is to uncover and understand the relationships between skills and questions. Additionally, we introduce an energy-saving attention mechanism for predicting knowledge states that is both simple and effective. This approach maintains high prediction accuracy while significantly reducing computational costs compared to conventional attention mechanisms. Extensive experimental results demonstrate the superior performance of our proposed model compared to other state-of-the-art baselines on three publicly available real-world datasets for knowledge tracking.

Authors

  • Zhijie Liang
    School of Computer Science, Sichuan Normal University, Chengdu, Sichuan, China.
  • Ruixia Wu
    School of Marxism, Sichuan Water Conservancy Vocational College, Chengdu, Sichuan, China.
  • Zhao Liang
    Network and Information Center, Southwest Petroleum University, Chengdu, Sichuan, China.
  • Juan Yang
    Department of Neurology, Shanghai Pudong New Area People's Hospital, Shanghai, China.
  • Ling Wang
    The State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, #7 Jinsui Road, Guangzhou, Guangdong 510230, China.
  • Jianyu Su
    School of Computer Science, Sichuan Normal University, Chengdu, Sichuan, China.