End-to-End Driving with Online Trajectory Evaluation via BEV World Model
About
End-to-end autonomous driving has achieved remarkable progress by integrating perception, prediction, and planning into a fully differentiable framework. Yet, to fully realize its potential, an effective online trajectory evaluation is indispensable to ensure safety. By forecasting the future outcomes of a given trajectory, trajectory evaluation becomes much more effective. This goal can be achieved by employing a world model to capture environmental dynamics and predict future states. Therefore, we propose an end-to-end driving framework WoTE, which leverages a BEV World model to predict future BEV states for Trajectory Evaluation. The proposed BEV world model is latency-efficient compared to image-level world models and can be seamlessly supervised using off-the-shelf BEV-space traffic simulators. We validate our framework on both the NAVSIM benchmark and the closed-loop Bench2Drive benchmark based on the CARLA simulator, achieving state-of-the-art performance. Code is released at https://github.com/liyingyanUCAS/WoTE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Autonomous Driving | NAVSIM v1 (test) | NC98.5 | 99 | |
| Closed-loop Planning | Bench2Drive | Driving Score61.71 | 90 | |
| Planning | NAVSIM (navtest) | NC98.5 | 53 | |
| Autonomous Driving | NAVSIM (test) | PDMS88.3 | 34 | |
| Closed-loop Autonomous Driving Planning | NAVSIM v1 (test) | NC98.5 | 26 | |
| Closed-loop Planning | Bench2Drive (test) | Driving Score61.71 | 21 | |
| Closed-loop Autonomous Driving | Bench2Drive | Driving Score (DS)61.71 | 21 | |
| Open-loop Autonomous Driving Planning | NAVSIM 1.0 (test) | NC98.5 | 19 | |
| Autonomous Driving | Bench2Drive base (train) | Driving Score61.71 | 19 | |
| Autonomous Driving | Bench2Drive 220 short segment scenarios | Driving Score61.71 | 18 |