Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CARLA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Autonomous DrivingCARLA 42 routes
Driving Score93.25
17
Autonomous DrivingCARLA weather town CoRL2017 (test)
Straight Success100
17
Autonomous DrivingCARLA weather CoRL2017 (train)
Straight Success Rate100
17
Visual Reinforcement LearningCARLA (#GP scenario)
ER9
15
Autonomous DrivingCARLA (#HW)
Error Rate-11
15
Autonomous DrivingCARLA Town05 (Long)
DS73.22
15
Autonomous DrivingCARLA Town05 (Short)
DS Score95.71
15
Motion PlanningCARLA Town05 Long Benchmark (test)
Driving Score55.9
14
Autonomous DrivingCARLA New town & weather original (test)
Straight Driving Success Rate100
12
Continual Instruction FollowingCARLA
Success Rate (SR)65.25
12
Semantic SegmentationCARLA ADV
mIoU37.97
11
End-to-end drivingCARLA Longest6 v2 (test)
Driving Score73
11
Autonomous DrivingCARLA Jun 2022 (public leaderboard)
Driving Score0.7618
10
Object DetectionCARLA simulator
AP@0.599
10
Autonomous DrivingCARLA 42 Routes v1 (internal evaluation)
Route Completion (RC)86.05
9
Autonomous DrivingCARLA Leaderboard
Return2,237.31
9
Autonomous DrivingCarla Official Town13 (devtest)
DS56.8
9
LiDAR Super-resolutionCARLA noise-free (test)
MAE0.7539
9
Image GenerationCARLA 128 x 128 (test)
FID6.7
9
Out-of-path View SynthesisCARLA (out-of-path)
PSNR26.23
8
Autonomous DrivingCARLA Town05 Long 1.0 (test)
Driving Score (DS)40.37
8
Autonomous DrivingCARLA Town05 Short 1.0 (test)
DS66.95
8
Autonomous DrivingCARLA
MACs (G)1.4
8
Video CompletionCARLA Town01
FVD117
8
Autonomous DrivingCARLA public leaderboard Jan 2022 (online)
Driving Score61.85
8
Showing 25 of 128 rows