Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EduAgent: Generative Student Agents in Learning

About

Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in educational contexts. Large language models (LLMs) may contain such prior knowledge since they are pre-trained from a large corpus. However, because student behaviors are dynamic and multifaceted with individual differences, directly prompting LLMs is not robust nor accurate enough to capture fine-grained interactions among diverse student personas, learning behaviors, and learning outcomes. This work tackles this problem by presenting a newly annotated fine-grained large-scale dataset and proposing EduAgent, a novel generative agent framework incorporating cognitive prior knowledge (i.e., theoretical findings revealed in cognitive science) to guide LLMs to first reason correlations among various behaviors and then make simulations. Our two experiments show that EduAgent could not only mimic and predict learning behaviors of real students but also generate realistic learning behaviors of virtual students without real data.

Songlin Xu, Xinyu Zhang, Lianhui Qin• 2024

Related benchmarks

TaskDatasetResultRank
Learner Correctness SimulationDBE-KT22
Accuracy69.95
23
Learner Answer SimulationDBE-KT22
Accuracy65.9
18
Correctness simulation accuracyDBE-KT22 100% historical interaction logs
Accuracy69.95
11
Correctness simulation accuracyDBE-KT22 20% historical interaction logs
Accuracy68.42
11
Correctness simulation accuracyDBE-KT22 30% historical interaction logs
Accuracy68.57
11
Correctness simulation accuracyDBE-KT22 50% historical interaction logs
Accuracy68.52
11
Learner Behavior SimulationDBE-KT22
Time (h)4
6
Correctness simulation accuracyDBE-KT22 0% historical interaction logs
Accuracy66.93
6
Learner Behavior SimulationEduHS
Simulation Time3
6
Showing 9 of 9 rows

Other info

Follow for update