Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HISE-KT: Synergizing Heterogeneous Information Networks and LLMs for Explainable Knowledge Tracing with Meta-Path Optimization

About

Knowledge Tracing (KT) aims to mine students' evolving knowledge states and predict their future question-answering performance. Existing methods based on heterogeneous information networks (HINs) are prone to introducing noises due to manual or random selection of meta-paths and lack necessary quality assessment of meta-path instances. Conversely, recent large language models (LLMs)-based methods ignore the rich information across students, and both paradigms struggle to deliver consistently accurate and evidence-based explanations. To address these issues, we propose an innovative framework, HIN-LLM Synergistic Enhanced Knowledge Tracing (HISE-KT), which seamlessly integrates HINs with LLMs. HISE-KT first builds a multi-relationship HIN containing diverse node types to capture the structural relations through multiple meta-paths. The LLM is then employed to intelligently score and filter meta-path instances and retain high-quality paths, pioneering automated meta-path quality assessment. Inspired by educational psychology principles, a similar student retrieval mechanism based on meta-paths is designed to provide a more valuable context for prediction. Finally, HISE-KT uses a structured prompt to integrate the target student's history with the retrieved similar trajectories, enabling the LLM to generate not only accurate predictions but also evidence-backed, explainable analysis reports. Experiments on four public datasets show that HISE-KT outperforms existing KT baselines in both prediction performance and interpretability.

Zhiyi Duan, Zixing Shi, Hongyu Yuan, Qi Wang• 2025

Related benchmarks

TaskDatasetResultRank
Knowledge TracingAssistments 2009
AUC0.8431
40
Knowledge TracingASSIST12
AUC72.33
24
Knowledge TracingDBE-KT22
Accuracy70.82
24
Knowledge TracingKnowledge Tracing Datasets
AUC84.31
7
Knowledge Tracing Report Quality EvaluationEedi
Explainability4.72
4
Showing 5 of 5 rows

Other info

Follow for update