Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Agent4Edu: Generating Learner Response Data by Generative Agents for Intelligent Education Systems

About

Personalized learning represents a promising educational strategy within intelligent educational systems, aiming to enhance learners' practice efficiency. However, the discrepancy between offline metrics and online performance significantly impedes their progress. To address this challenge, we introduce Agent4Edu, a novel personalized learning simulator leveraging recent advancements in human intelligence through large language models (LLMs). Agent4Edu features LLM-powered generative agents equipped with learner profile, memory, and action modules tailored to personalized learning algorithms. The learner profiles are initialized using real-world response data, capturing practice styles and cognitive factors. Inspired by human psychology theory, the memory module records practice facts and high-level summaries, integrating reflection mechanisms. The action module supports various behaviors, including exercise understanding, analysis, and response generation. Each agent can interact with personalized learning algorithms, such as computerized adaptive testing, enabling a multifaceted evaluation and enhancement of customized services. Through a comprehensive assessment, we explore the strengths and weaknesses of Agent4Edu, emphasizing the consistency and discrepancies in responses between agents and human learners. The code, data, and appendix are publicly available at https://github.com/bigdata-ustc/Agent4Edu.

Weibo Gao, Qi Liu, Linan Yue, Fangzhou Yao, Rui Lv, Zheng Zhang, Hao Wang, Zhenya Huang• 2025

Related benchmarks

TaskDatasetResultRank
Learner Correctness SimulationDBE-KT22
Accuracy71.3
23
Learner Answer SimulationDBE-KT22
Accuracy67.4
18
Correctness simulation accuracyDBE-KT22 20% historical interaction logs
Accuracy69.32
11
Correctness simulation accuracyDBE-KT22 30% historical interaction logs
Accuracy69.43
11
Correctness simulation accuracyDBE-KT22 50% historical interaction logs
Accuracy69.95
11
Correctness simulation accuracyDBE-KT22 100% historical interaction logs
Accuracy71.3
11
Curriculum Optimization9-1-1 Call-Taker Training Struggling Learner λ=0.03, ψ=0.35
C@1057.15
8
Curriculum Optimization9-1-1 Call-Taker Training Quick Forgetter (λ=0.10, ψ=0.45)
C@1072.54
8
Curriculum Optimization9-1-1 Call-Taker Fast Learner λ=0.12, ψ=0.15 (train)
C@1068.14
8
Curriculum Optimization9-1-1 Call-Taker Training Moderate Learner λ=0.07, ψ=0.25
C@10 Score62.41
8
Showing 10 of 13 rows

Other info

Follow for update