Edu-Theater: A Data-Efficient Agent Framework for Scalable Learner Behavior Simulation through Staging Roll-Call
About
Large-scale learner-task interaction data are crucial for intelligent educational systems but are costly to collect and constrained by privacy and learner engagement. Learner simulators play a critical role in simulating scalable learner behavior without the need for continuous involvement of real learners. However, existing methods are predominantly \textbf{individual-centric}, pairing a simulator with each learner to iteratively infer latent knowledge states from dense interaction histories, which is both data- and computation-intensive, and fragile in cold-start scenarios. We propose a \textbf{cohort-aware roll-call simulation paradigm} that first constructs cohort-level proficiency priors and refines individual learner states through a small number of targeted diagnostic queries. Based on this paradigm, we introduce \textbf{Edu-Theater}, an LLM-powered agent system that performs cohort-aware learner simulation via a teacher agent and retrospective roll-call probing over learner logs. Edu-Theater enables scalable future behavior simulation without the need for dense per-learner histories. Experiments on two real-world datasets demonstrate that Edu-Theater achieves higher simulation accuracy with significantly fewer LLM calls, producing synthetic data that enhances downstream applications such as adaptive testing.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Learner Correctness Simulation | DBE-KT22 | Accuracy73.03 | 23 | |
| Learner Answer Simulation | DBE-KT22 | Accuracy69.4 | 18 | |
| Correctness simulation accuracy | DBE-KT22 20% historical interaction logs | Accuracy69.9 | 11 | |
| Correctness simulation accuracy | DBE-KT22 30% historical interaction logs | Accuracy70.33 | 11 | |
| Correctness simulation accuracy | DBE-KT22 50% historical interaction logs | Accuracy71.27 | 11 | |
| Correctness simulation accuracy | DBE-KT22 100% historical interaction logs | Accuracy73.03 | 11 | |
| Correctness simulation accuracy | DBE-KT22 0% historical interaction logs | Accuracy68.85 | 6 | |
| Learner Behavior Simulation | DBE-KT22 | Time (h)3 | 6 | |
| Learner Behavior Simulation | EduHS | Simulation Time2 | 6 | |
| Learner Performance Prediction | DBE-KT22+ original and augmented (test) | -- | 6 |