PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policies
About
Reliable action generation for multi-stage robotic manipulation remains challenging for Vision-Language-Action (VLA) models. While existing flow-matching VLA policies offer strong multimodal grounding and generalization, they typically employ a single shared action expert, limiting their ability to capture phase-specific control patterns across distinct execution stages. We propose a plug-and-play Phase-Aware Mixture-of-Experts Action Module (PAMAE), as a step towards more reliable phase-consistent action generation. PAMAE replaces the original flow-matching action expert with a sparse expert mixture while preserving the pretrained VLA backbone. PAMAE introduces a phase-aware router that leverages execution-phase cues to allocate action generation across experts, supported by a lightweight phase prediction head and a routing alignment objective. To stabilize specialization, we adopt a two-stage training scheme that first warms up the expert module under the standard flow-matching loss and then optimizes phase-consistent routing under auxiliary supervision. On multi-stage manipulation simulation tasks, PAMAE improves task success by up to \textbf{9.2\%} over strong VLA baselines. Further ablations show that both phase-supervised routing and staged optimization are essential for the observed gains. Our results highlight phase-consistent expert allocation as an effective mechanism for improving the reliability and action quality of flow-matching VLA policies.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Cup-Upright | Multi-stage Manipulation Simulation (test) | Success Rate97 | 6 | |
| Drawer-Cycle | Multi-stage Manipulation Simulation (test) | Success Rate89 | 6 | |
| Lid-Open | Multi-stage Manipulation Simulation (test) | Success Rate92 | 6 | |
| Shelf-Insert | Multi-stage Manipulation Simulation (test) | Success Rate86 | 6 | |
| Table Cleaning | Multi-stage Manipulation Simulation (test) | Success Rate93 | 6 |