Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EVOCHAMBER: Test-Time Co-evolution of Multi-Agent System at Individual, Team, and Population Scales

About

We argue that multi-agent test-time evolution is not single-agent evolution replicated N times. A single-agent learner can only evolve its own context and memory. A multi-agent system additionally evolves who collaborates, how they collaborate, and how knowledge flows across the population. These components have no single-agent counterpart and can produce phenomena such as emergent specialization. Yet prior test-time methods either confine experiences to individual agents, forfeiting cross-agent learning, or broadcast symmetrically to all agents, erasing the specialization that makes collaboration valuable. We present EVOCHAMBER, a training-free framework that instantiates test-time evolution at three levels over a coevolving agent pool. At its core is CODREAM (Collaborative Dreaming), a post-task protocol triggered on team failure or disagreement, in which agents collaboratively reflect, distill insights, and route them asymmetrically from strong to weak agents on the failed niche, preserving specialization while filling knowledge gaps. Team-level operators assemble niche-conditioned teams and select collaboration structures online. Population-level lifecycle operators fork, merge, prune, and seed agents under performance pressure. On three heterogeneous task streams with Qwen3-8B, EVOCHAMBER reaches 63.9% on competition math, 75.7% on code, and 87.1% on multi-domain reasoning, outperforming the best baseline by 32% relative on math and confirming asymmetric cross-agent transfer as the primary driver in ablation. Starting from several identically initialized agents, four to five stable niche specialists spontaneously emerge, a structural signature of multi-agent evolution that no single-agent learner can express. See our code at: https://github.com/Mercury7353/EvoChamber

Yaolun Zhang, Tianyi Xu, Shengyu Dai, Zhenwen Shao, Qingyun Wu, Huazheng Wang• 2026

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningAIME 2024
Accuracy43.3
525
Mathematical ReasoningAIME 2025
Pass@1 Accuracy30
192
Mathematical ReasoningAIME 2023
Accuracy (%)33.3
36
Mathematical ReasoningAIME 2022
Accuracy (Exact Match)40
12
Multi-domain reasoningAFlow-Stream (test)
GSM8K Accuracy98
11
Mathematical ReasoningMATH hard Level 4 5
Accuracy (Exact Match)76.3
7
Mathematical ReasoningHard Math Stream Overall
Accuracy (micro-average)63.9
7
Code GenerationHard Code Stream MBPP+, CC, HumanEval
MBPP+ Accuracy86.1
7
Mathematical ReasoningHard Math Stream (test)
Accuracy (Hard Math Stream)88.9
4
Showing 9 of 9 rows

Other info

GitHub

Follow for update