GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving
About
End-to-end autonomous driving has made significant progress by unifying perception, prediction, and planning within a single learning framework, achieving strong performance in short-horizon decision making. However, most existing E2E-AD methods remain confined to short-horizon planning and lack the ability to model long-term temporal dependencies, which severely limits their generalization and security in complex and highly interactive driving scenarios. In this work, we propose GraphWorld, an E2E-AD framework that explicitly enhances long-horizon planning through latent world modeling. We introduce an Ego-Centric Interaction Graph, which adaptively models critical neighboring agents based on spatial proximity, and propagates relational context to planning queries via cross-node cross-attention. We present a World-State-Conditioned Planning that learns ego-centric latent world representations by modeling interactions between an ego vehicle and surrounding agents. This latent world state captures key interaction dynamics and safety-relevant semantics, and serves as a conditioning signal to guide long-horizon, safety-aware trajectory planning. Extensive experiments on Bench2Drive, NAVSIMv1/2, and nuScenes demonstrate that GraphWorld significantly reduces collision rates and improves long-horizon planning performance, validating its effectiveness in complex driving environments.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Autonomous Driving Planning | NAVSIM navhard v2 | NC98.1 | 108 | |
| Autonomous Driving Planning | NAVSIM v2 (Navtest) | NC98.4 | 76 | |
| Planning | NAVSIM v1 (test) | PDMS90.1 | 62 | |
| Closed-loop Autonomous Driving | Bench2Drive V0.0.3 | Driving Score (DS)76.71 | 16 | |
| Planning | nuScenes C | Collision Rate (1s)0.00e+0 | 16 | |
| Planning | nuScenes (val) | L2 Error (1s)0.38 | 16 | |
| Short-horizon planning | nuScenes (val) | Collision Rate (1s)0.00e+0 | 12 | |
| Open-loop trajectory prediction | Bench2Drive V0.0.3 | Avg L2 Error0.79 | 12 | |
| Motion Prediction | nuScenes | ADE [m]0.55 | 8 | |
| Planning | Adv-nuSc | Collision Rate (1s)0.028 | 6 |