FocalPolicy: Frequency-Optimized Chunking and Locally Anchored Flow Matching for Coherent Visuomotor Policy
About
Visuomotor policies aim to learn complex manipulation tasks from expert demonstrations. However, generating smooth and coherent trajectories remains challenging, as it requires balancing proximal precision with distal foresight. Existing approaches typically focus on optimizing intra-chunk action distributions, often neglecting the inter-chunk coherence. Consequently, inter-chunk discontinuities significantly impede the learning of coherent long-horizon actions. To overcome this limitation and achieve a synergetic balance between precision and foresight, we propose FocalPolicy, a foresight-aware visuomotor policy that combines Frequency-Optimized Chunking with Locally Anchored flow matching. We introduce a foresight composite objective that supervises time-domain alignment within the proximal actions while regularizing frequency-domain structure over multiple future action chunks to improve cross-chunk coherence. To efficiently learn complex action distributions, we design locally anchored sampling to enhance target signal propagation efficiency during consistency flow matching training. Extensive experiments demonstrate that FocalPolicy outperforms existing approaches and confirm the generalizability of our modules to other baselines. Project website: https://focalpolicy.github.io/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robot Manipulation | MetaWorld Medium 11 tasks | Success Rate81.9 | 25 | |
| Robot Manipulation | MetaWorld Hard (6 tasks) | Success Rate51.8 | 25 | |
| Robot Manipulation | MetaWorld Very Hard 5 tasks | Success Rate85.1 | 22 | |
| Robot Manipulation | MetaWorld Easy 28 tasks | Success Rate91.4 | 16 | |
| Robot Manipulation | Adroit 3 tasks | -- | 10 | |
| Visuomotor Policy | Simulation Average 53 tasks | Average Success Rate83.6 | 7 | |
| Cup Matching | Real-world Cup Matching Stage 1 | Success Rate73.3 | 4 | |
| Cup Matching | Real-world Cup Matching Stage 2 | Success Rate56.7 | 4 | |
| Cup Matching | Real-world Cup Matching Stage 3 | Success Rate50 | 4 | |
| Cup Matching | Real-world Cup Matching Stage 4 | Success Rate30 | 4 |