Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Urgency Prediction on VecEval (val)
Loading...
12.12
Intervention Failure Rate
FleetAgent
11.9628
13.0239
14.085
15.1461
Jun 19, 2026
Intervention Failure Rate
Updated 1mo ago
Evaluation Results
Method
Method
Links
Intervention Failure Rate
FleetAgent
Input Modality=Vectori...
2026.06
12.12
FleetAgent (w/o tokens prioritization)
Input Modality=Vectori...
2026.06
12.42
GPT-4o
Input Modality=Languag...
2026.06
13.63
Qwen-2.5VL-7B
Input Modality=BEV Ima...
2026.06
13.83
Qwen-2.5VL-7B
Input Modality=Languag...
2026.06
15.14
GPT-4o
Input Modality=Raw Images
2026.06
15.24
Qwen-2.5VL-7B
Input Modality=Raw Ima...
2026.06
15.9
Gemini-2.5-Flash (Reference Baseline)
Input Modality=Languag...
2026.06
16
GPT-4o
Input Modality=BEV Images
2026.06
16.05
Feedback
Search any
task
Search any
task