Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving

About

This paper presented DriveArena, the first high-fidelity closed-loop simulation system designed for driving agents navigating in real scenarios. DriveArena features a flexible, modular architecture, allowing for the seamless interchange of its core components: Traffic Manager, a traffic simulator capable of generating realistic traffic flow on any worldwide street map, and World Dreamer, a high-fidelity conditional generative model with infinite autoregression. This powerful synergy empowers any driving agent capable of processing real-world images to navigate in DriveArena's simulated environment. The agent perceives its surroundings through images generated by World Dreamer and output trajectories. These trajectories are fed into Traffic Manager, achieving realistic interactions with other vehicles and producing a new scene layout. Finally, the latest scene layout is relayed back into World Dreamer, perpetuating the simulation cycle. This iterative process fosters closed-loop exploration within a highly realistic environment, providing a valuable platform for developing and evaluating driving agents across diverse and challenging scenarios. DriveArena signifies a substantial leap forward in leveraging generative image data for the driving simulation platform, opening insights for closed-loop autonomous driving. Code will be available soon on GitHub: https://github.com/PJLab-ADG/DriveArena

Xuemeng Yang, Licheng Wen, Yukai Ma, Jianbiao Mei, Xin Li, Tiantian Wei, Wenjie Lei, Daocheng Fu, Pinlong Cai, Min Dou, Botian Shi, Liang He, Yong Liu, Yu Qiao• 2024

Related benchmarks

TaskDatasetResultRank
3D Object DetectionnuScenes (val)
NDS30.03
249
3D Object DetectionnuScenes
mAP (All)16.06
41
Driving Scene GenerationnuScenes (val)
FID16.03
27
3D Object DetectionnuScenes Rainy (val)
mAP33.46
27
PlanningnuScenes
L2 Error (1s)0.56
26
Map SegmentationnuScenes
Drivable Area59.37
19
PlanningnuScenes (val)
L2 Error (1s)0.56
16
BeV SegmentationnuScenes (val)--
16
3D Object DetectionnuScenes night
mAP8.89
14
Image GenerationnuScenes
FID14.17
12
Showing 10 of 22 rows

Other info

Follow for update