FPC-VLA: A Vision-Language-Action Framework with a Supervisor for Failure Prediction and Correction
About
Robotic manipulation is a fundamental component of automation. However, traditional perception-planning pipelines often fall short in open-ended tasks due to limited flexibility, while the architecture of a single end-to-end Vision-Language-Action (VLA) offers promising capabilities but lacks crucial mechanisms for anticipating and recovering from failure. To address these challenges, we propose FPC-VLA, a dual-model framework that integrates VLA with a supervisor for failure prediction and correction. The supervisor evaluates action viability through vision-language queries and generates corrective strategies when risks arise, trained efficiently without manual labeling. A dual-stream fusion module further refines actions by leveraging past predictions. Evaluation results on multiple simulation platforms (SIMPLER and LIBERO) and robot embodiments (WidowX, Google Robot, Franka) show that FPC-VLA outperforms state-of-the-art models in both zero-shot and fine-tuned settings. Successful real-world deployments on diverse, long-horizon tasks confirm FPC-VLA's strong generalization and practical utility for building more reliable autonomous systems.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robot Manipulation | LIBERO | Object Achievement92 | 1025 | |
| Robotic Manipulation | LIBERO | Long-horizon Success Rate82.2 | 165 | |
| Robot Manipulation | SimplerEnv WidowX | Overall Success Rate64.6 | 123 | |
| Robotic Manipulation | WidowX | Spoon Success Rate58.3 | 17 | |
| Robot Manipulation | LIBERO | Spatial Success Rate86.2 | 15 | |
| Robot Manipulation | SimplerEnv RT-1 Visual Matching | Success Rate78 | 14 | |
| Robot Manipulation | SimplerEnv RT-1 Visual Augmentation | Success Rate65.8 | 14 | |
| Robotic Manipulation | LIBERO 50 rollouts per task | Spatial Success0.87 | 10 |