Verifier-free Test-Time Sampling for Vision-Language-Action Models
About
Vision-Language-Action models (VLAs) have demonstrated remarkable performance in robot control. However, they remain fundamentally limited in tasks that require high precision due to their single-inference paradigm. While test-time scaling approaches using external verifiers have shown promise, they require additional training and fail to generalize to unseen conditions. We propose Masking Distribution Guided Selection (MG-Select), a novel test-time scaling framework for VLAs that leverages the model's internal properties without requiring additional training or external modules. Our approach utilizes KL divergence from a reference action token distribution as a confidence metric for selecting the optimal action from multiple candidates. We introduce a reference distribution generated by the same VLA but with randomly masked states and language conditions as inputs, providing action uncertainty while remaining aligned with the target task distribution. Additionally, we propose a joint training strategy that enables the model to learn both conditional and unconditional distributions by applying dropout to state and language conditions, thereby further improving the quality of the reference distribution. Our experiments demonstrate that MG-Select provides a reliable reference for action selection through task-relevant condition masking and consistently improves base models across diverse simulation and real-world benchmarks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robotic Manipulation | LIBERO | Long-horizon Success Rate82.7 | 165 | |
| Robot Manipulation | LIBERO Object | Success Rate73 | 139 | |
| Robotic Manipulation | LIBERO Long | Success Rate55 | 97 | |
| Robotic Manipulation | LIBERO Spatial Object Goal Long | Overall Success Rate (Long)55.4 | 91 | |
| Robotic Manipulation | RoboCasa | Average Success Rate62.9 | 68 | |
| Robot Manipulation | LIBERO | Spatial Success Rate76.8 | 58 | |
| Robotic Manipulation | LIBERO Goal | Success Rate73 | 55 | |
| Robotic Manipulation | LIBERO Average across suites | Success Rate (SR)71 | 29 | |
| Robotic Manipulation | LIBERO Spatial | Success Rate (SR)82 | 28 | |
| Language-conditioned long-horizon robotic manipulation | Calvin ABC->D | Success Rate (1 Task)96.9 | 22 |