EduAgent: Generative Student Agents in Learning
About
Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in educational contexts. Large language models (LLMs) may contain such prior knowledge since they are pre-trained from a large corpus. However, because student behaviors are dynamic and multifaceted with individual differences, directly prompting LLMs is not robust nor accurate enough to capture fine-grained interactions among diverse student personas, learning behaviors, and learning outcomes. This work tackles this problem by presenting a newly annotated fine-grained large-scale dataset and proposing EduAgent, a novel generative agent framework incorporating cognitive prior knowledge (i.e., theoretical findings revealed in cognitive science) to guide LLMs to first reason correlations among various behaviors and then make simulations. Our two experiments show that EduAgent could not only mimic and predict learning behaviors of real students but also generate realistic learning behaviors of virtual students without real data.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Learner Correctness Simulation | DBE-KT22 | Accuracy69.95 | 23 | |
| Learner Answer Simulation | DBE-KT22 | Accuracy65.9 | 18 | |
| Correctness simulation accuracy | DBE-KT22 100% historical interaction logs | Accuracy69.95 | 11 | |
| Correctness simulation accuracy | DBE-KT22 20% historical interaction logs | Accuracy68.42 | 11 | |
| Correctness simulation accuracy | DBE-KT22 30% historical interaction logs | Accuracy68.57 | 11 | |
| Correctness simulation accuracy | DBE-KT22 50% historical interaction logs | Accuracy68.52 | 11 | |
| Learner Behavior Simulation | DBE-KT22 | Time (h)4 | 6 | |
| Correctness simulation accuracy | DBE-KT22 0% historical interaction logs | Accuracy66.93 | 6 | |
| Learner Behavior Simulation | EduHS | Simulation Time3 | 6 |