Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Edu-Theater: A Data-Efficient Agent Framework for Scalable Learner Behavior Simulation through Staging Roll-Call

About

Large-scale learner-task interaction data are crucial for intelligent educational systems but are costly to collect and constrained by privacy and learner engagement. Learner simulators play a critical role in simulating scalable learner behavior without the need for continuous involvement of real learners. However, existing methods are predominantly \textbf{individual-centric}, pairing a simulator with each learner to iteratively infer latent knowledge states from dense interaction histories, which is both data- and computation-intensive, and fragile in cold-start scenarios. We propose a \textbf{cohort-aware roll-call simulation paradigm} that first constructs cohort-level proficiency priors and refines individual learner states through a small number of targeted diagnostic queries. Based on this paradigm, we introduce \textbf{Edu-Theater}, an LLM-powered agent system that performs cohort-aware learner simulation via a teacher agent and retrospective roll-call probing over learner logs. Edu-Theater enables scalable future behavior simulation without the need for dense per-learner histories. Experiments on two real-world datasets demonstrate that Edu-Theater achieves higher simulation accuracy with significantly fewer LLM calls, producing synthetic data that enhances downstream applications such as adaptive testing.

Weibo Gao, Qi Liu, Linan Yue, Zheng Zhang, Yichao Du, Fangzhou Yao, Ao Yu, Zhenya Huang, Shijin Wang• 2026

Related benchmarks

TaskDatasetResultRank
Learner Correctness SimulationDBE-KT22
Accuracy73.03
23
Learner Answer SimulationDBE-KT22
Accuracy69.4
18
Correctness simulation accuracyDBE-KT22 20% historical interaction logs
Accuracy69.9
11
Correctness simulation accuracyDBE-KT22 30% historical interaction logs
Accuracy70.33
11
Correctness simulation accuracyDBE-KT22 50% historical interaction logs
Accuracy71.27
11
Correctness simulation accuracyDBE-KT22 100% historical interaction logs
Accuracy73.03
11
Correctness simulation accuracyDBE-KT22 0% historical interaction logs
Accuracy68.85
6
Learner Behavior SimulationDBE-KT22
Time (h)3
6
Learner Behavior SimulationEduHS
Simulation Time2
6
Learner Performance PredictionDBE-KT22+ original and augmented (test)--
6
Showing 10 of 10 rows

Other info

Follow for update