CARLA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Closed-loop planning | CARLA Bench2Drive (leaderboard) | Driving Score (DS)87.34 | 17 | |
| Autonomous Driving | CARLA 42 routes | Driving Score93.25 | 17 | |
| Autonomous Driving | CARLA weather town CoRL2017 (test) | Straight Success100 | 17 | |
| Autonomous Driving | CARLA weather CoRL2017 (train) | Straight Success Rate100 | 17 | |
| Autonomous Driving | CARLA Town 2 (test) | AS21.4 | 15 | |
| Visual Reinforcement Learning | CARLA (#GP scenario) | ER9 | 15 | |
| Autonomous Driving | CARLA (#HW) | Error Rate-11 | 15 | |
| Autonomous Driving | CARLA Town05 (Long) | DS73.22 | 15 | |
| Autonomous Driving | CARLA Town05 (Short) | DS Score95.71 | 15 | |
| Motion Planning | CARLA Town05 Long Benchmark (test) | Driving Score55.9 | 14 | |
| Autonomous Driving | CARLA Town 2 (train) | AS25.1 | 12 | |
| Autonomous Driving | CARLA Town 2 10 unseen (test) | AS Score24.32 | 12 | |
| Autonomous Driving | CARLA New town & weather original (test) | Straight Driving Success Rate100 | 12 | |
| Continual Instruction Following | CARLA | Success Rate (SR)65.25 | 12 | |
| Semantic Segmentation | CARLA ADV | mIoU37.97 | 11 | |
| End-to-end driving | CARLA Longest6 v2 (test) | Driving Score73 | 11 | |
| Autonomous Driving | CARLA Jun 2022 (public leaderboard) | Driving Score0.7618 | 10 | |
| Object Detection | CARLA simulator | AP@0.599 | 10 | |
| Autonomous Driving Navigation | CARLA Town 2 10 routes | Average Speed17.47 | 9 | |
| Autonomous Driving | CARLA 42 Routes v1 (internal evaluation) | Route Completion (RC)86.05 | 9 | |
| Autonomous Driving | CARLA Leaderboard | Return2,237.31 | 9 | |
| Autonomous Driving | Carla Official Town13 (devtest) | DS56.8 | 9 | |
| LiDAR Super-resolution | CARLA noise-free (test) | MAE0.7539 | 9 | |
| Image Generation | CARLA 128 x 128 (test) | FID6.7 | 9 | |
| Out-of-Distribution Segmentation | CARLA OOD | FPR@9525.85 | 8 |
Showing 25 of 174 rows