Multi-Agent Coordination Adaptation via Structure-Guided Orchestration
About
As large language model (LLM)-based multi-agent systems scale to handle increasingly complex tasks, balancing structural stability and dynamic adaptability becomes increasingly challenging. Existing systems typically adopt either structure-centric methods, committing to structures determined upfront that limit fine-grained control, or orchestration-centric methods, adapting decisions dynamically while leaving coordination structure implicit and unstable. To address this challenge, we revisit multi-agent coordination from a probabilistic perspective, casting it as posterior inference over the joint distribution of structure and orchestration. We introduce MACA, an automated coordination framework that learns a task- and budget-conditioned structural prior over agent participation and interactions. This prior guides a policy-based orchestration as an approximation to posterior inference, enabling efficient solutions with fine-grained control. Across benchmarks, MACA outperforms adaptive multi-agent baselines by an average of 8.42% while using 43.19% fewer tokens. Further investigation reveals that joint adaptation of structure and orchestration suppresses redundant interactions, converging coordination toward task-effective execution.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Math Reasoning | GSM-Hard | Accuracy67.37 | 73 | |
| Question Answering | MMLU-Pro | Accuracy64.57 | 18 | |
| Code Generation | HumanEval | Accuracy75.76 | 12 | |
| Code Generation | MBPP | Accuracy (%)49.23 | 12 | |
| Math Reasoning | SVAMP | Accuracy (%)96 | 12 | |
| Question Answering | ARC-C | Accuracy87.75 | 12 | |
| Code Generation | HumanEval | Accuracy88.89 | 6 | |
| Code Generation | HumanEval | Accuracy86.89 | 6 | |
| Mathematical Reasoning | GSM-Hard | Accuracy63.28 | 6 | |
| Multitask Language Understanding | MMLU-Pro | Accuracy64.46 | 6 |