End-to-End Driving with Online Trajectory Evaluation via BEV World Model
About
End-to-end autonomous driving has achieved remarkable progress by integrating perception, prediction, and planning into a fully differentiable framework. Yet, to fully realize its potential, an effective online trajectory evaluation is indispensable to ensure safety. By forecasting the future outcomes of a given trajectory, trajectory evaluation becomes much more effective. This goal can be achieved by employing a world model to capture environmental dynamics and predict future states. Therefore, we propose an end-to-end driving framework WoTE, which leverages a BEV World model to predict future BEV states for Trajectory Evaluation. The proposed BEV world model is latency-efficient compared to image-level world models and can be seamlessly supervised using off-the-shelf BEV-space traffic simulators. We validate our framework on both the NAVSIM benchmark and the closed-loop Bench2Drive benchmark based on the CARLA simulator, achieving state-of-the-art performance. Code is released at https://github.com/liyingyanUCAS/WoTE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Closed-loop Planning | Bench2Drive | Driving Score61.71 | 137 | |
| Autonomous Driving | NAVSIM v1 (test) | NC98.5 | 113 | |
| Autonomous Driving Planning | NAVSIM v1 | NC98.5 | 86 | |
| Autonomous Driving Planning | NAVSIM (navtest) | NC98.5 | 68 | |
| Autonomous Driving Planning | NAVSIM v1 (test) | NC98.5 | 59 | |
| Planning | NAVSIM (navtest) | NC98.5 | 53 | |
| Closed-loop Autonomous Driving | Bench2Drive | Driving Score (DS)61.71 | 49 | |
| Autonomous Driving | NAVSIM (test) | PDMS88.3 | 48 | |
| Closed-loop Autonomous Driving Planning | NAVSIM v1 (test) | NC98.5 | 36 | |
| End-to-end Planning | NAVSIM v1 | NC98.5 | 32 |