Chronos: A Physics-Informed Full-History Framework for Non-Markovian Long-Horizon Manipulation
About
General-purpose robot policies should be modeled as dynamical systems, yet many VLA and generative imitation policies still rely on present observations or short windows. This Markovian shortcut fails in memory-dependent manipulation: identical observations can demand different actions after different histories. We present Chronos, a physics-informed full-history framework for non-Markovian long-horizon manipulation. The key idea is to elevate observation history from auxiliary context to the latent state of the policy dynamics. At each physical control step, Chronos forms one state-representative token by fusing observation and proprioception, so the token sequence is aligned one-to-one with physical time. A selective state space model propagates this causal historical state, which conditions a multimodal coarse action prior through implicit maximum likelihood estimation (IMLE). This prior is then refined by a second-order Schrodinger-inspired bridge that predicts acceleration fields, yielding smoother and more physically grounded robot motion. Across 16 simulated tasks and 4 real-world experiments, Chronos is evaluated on precision insertion, general manipulation, and memory-dependent long-horizon control. On RMBench, where success requires remembering task phase, Chronos achieves 73.6% average success, outperforming Markovian VLA baseline pi0.5 by +62.4 percentage points, a 6.6x relative gain, while using 10x fewer parameters. It also surpasses the memory VLA Mem-0 by 22.8 points while using over 30x fewer parameters. In real-world dual-arm experiments using a single RGB camera, Chronos achieves 78% average success over four tasks, including 72% on the three memory-dependent tasks, whereas pi0.5 achieves 7% overall and 0% on the memory-dependent subset. These results suggest that history should not be treated as auxiliary context, but as the latent state of the manipulation policy.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robotic Manipulation | RoboTwin 2.0 (Easy-Protocol) | Hanging Mug Success Rate26 | 6 | |
| Robotic Manipulation | RMBench Memory-dependent (evaluation) | Rearrange Blocks Success Rate98 | 6 | |
| Cover Blocks | Real-world dual-arm platform Cover Blocks trials | Success Count10 | 2 | |
| Memory-dependent Robotic Manipulation (Aggregate) | Real-world dual-arm platform Memory tasks aggregate | Success Count108 | 2 | |
| Put Back Blocks | Real-world dual-arm platform Put Back Blocks trials | Success Count49 | 2 | |
| Robotic Manipulation (Aggregate) | Real-world dual-arm platform All tasks aggregate | Success Count156 | 2 | |
| Swap T | Real-world dual-arm platform Swap T trials | Success Count48 | 2 | |
| Swap T-Mem | Real-world dual-arm platform Swap T-Mem trials | Success Count49 | 2 |