Share your thoughts, 1 month free Claude Pro on usSee more

Autonomous Driving Reasoning on DriveLMM-o1

82.31Risk Assessment

OmniDrive-R1

Updated 18d ago

Evaluation Results

Method
OmniDrive-R1 2025.12	82.31	85.42	83.75	82.58	78.26	80.35	73.62	-	-	-	-	-
OmniDrive-R1 2026.07	82.31	85.42	83.75	82.58	78.26	80.35	73.62	-	-	-	-	-
CritiqueDriveVLM-Teacher 2026.07	81.63	86.21	82.27	85.46	79.17	80.48	76.54	-	-	-	-	-
Agentthink 2025.12	80.51	84.98	82.11	84.99	79.56	79.68	71.35	-	-	-	-	-
AgentThink 2026.07	80.51	84.98	82.11	84.99	79.56	79.68	71.35	-	-	-	-	-
Qwen3-VL 2026.07	79.5	84.32	80.41	84.43	75.32	77.76	55.54	-	-	-	-	-
DriveLMM-o1 2026.06	73.81	82.26	75.64	79.51	71.38	74.37	-	-	-	-	-	-
DriveLMM-o1 2025.12	73.01	81.56	75.39	79.42	74.49	75.24	62.36	-	-	-	-	-
DriveLMM-o1 2026.07	73.01	81.56	75.39	79.42	74.49	75.24	62.36	-	-	-	-	-
MVPruner 2026.06	72.91	81.96	74.85	78.55	71.58	73.79	-	-	-	-	-	-
MVPruner 2026.06	72.05	81.81	73.8	77.61	70.25	72.91	-	-	-	-	-	-
DivPrune 2026.06	71.66	78.39	73.04	77.45	69.92	71.67	-	-	-	-	-	-
DART 2026.06	71.5	78.21	72.8	77.33	69.63	71.46	-	-	-	-	-	-
FastV 2026.06	71.35	80.58	72.85	76.74	69.25	72.41	-	-	-	-	-	-
GPT-4o 2025.12	71.32	80.72	72.96	76.65	71.43	72.52	57.84	-	-	-	-	-
GPT-4o 2026.07	71.32	80.72	72.96	76.65	71.43	72.52	57.84	-	-	-	-	-
Prune2Drive 2026.06	71.31	80.74	73.07	77.48	69.3	72.69	-	-	-	-	-	-
PACT 2026.06	71.2	78.11	71.44	77.21	68.95	70.95	-	-	-	-	-	-
Prune2Drive 2026.06	70.76	77.66	72.29	77.01	68.94	70.31	-	-	-	-	-	-
SparseVLM 2026.06	70.08	79.59	71.87	75.66	67.43	71.23	-	-	-	-	-	-
DivPrune 2026.06	69.32	76.47	70.78	75.53	68.22	69.65	-	-	-	-	-	-
InternVL2.5-8B 2025.12	69.02	78.43	71.52	75.8	70.54	71.62	54.87	-	-	-	-	-
InternVL2.5 2026.07	69.02	78.43	71.52	75.8	70.54	71.62	54.87	-	-	-	-	-
DART 2026.06	68.6	75.81	69.97	74.94	67.6	69.01	-	-	-	-	-	-
PACT 2026.06	68.2	76.23	69.11	74.14	66.1	68.38	-	-	-	-	-	-
SparseVLM 2026.06	68.18	77.81	69.87	73.98	66.2	69.4	-	-	-	-	-	-
FastV 2026.06	67.74	78.07	69.37	73.24	66.02	69.56	-	-	-	-	-	-
Qwen2.5VL-72B 2025.12	64.4	72.81	60.29	65.13	62.81	65.73	61.27	-	-	-	-	-
Qwen2.5-VL 2026.07	64.4	72.81	60.29	65.13	62.81	65.73	61.27	-	-	-	-	-
LlamaV-O1 2025.12	60.2	73.52	62.67	64.66	63.41	63.13	50.02	-	-	-	-	-
LlamaV-O1 2026.07	60.2	73.52	62.67	64.66	63.41	63.13	50.02	-	-	-	-	-
LLaVA-CoT 2025.12	57.62	69.01	60.84	62.72	60.67	61.41	49.27	-	-	-	-	-
LLaVA-CoT 2026.07	57.62	69.01	60.84	62.72	60.67	61.41	49.27	-	-	-	-	-
DriveLMM-o1 2026.03	53.08	68.52	49.91	-	-	56.63	51.14	47.43	50.96	51.7	-	-
RailVQA-CoM 2026.03	52.88	68.07	56.48	-	-	58.89	54.57	48.66	52.81	53.77	-	-
DriveLMM-o1 2026.03	52.55	67.22	54.67	-	-	57.48	54.11	49.84	51.2	51.69	-	-
Mulberry-7B 2025.12	51.89	63.66	56.68	57.27	57.45	57.65	52.86	-	-	-	-	-
Mulberry 2026.07	51.89	63.66	56.68	57.27	57.45	57.65	52.86	-	-	-	-	-
Ovis1.5-Gemma2-9B 2025.12	51.34	66.36	54.74	55.72	55.74	55.62	48.85	-	-	-	-	-
Ovis1.5-Gemma2 2026.07	51.34	66.36	54.74	55.72	55.74	55.62	48.85	-	-	-	-	-
Qwen2.5VL-7B 2025.12	46.44	60.45	51.02	50.15	52.19	51.77	37.81	-	-	-	-	-
Qwen2.5-VL 2026.07	46.44	60.45	51.02	50.15	52.19	51.77	37.81	-	-	-	-	-
GPT-4o 2026.04	-	-	-	-	-	-	-	-	-	-	57.84	-
Qwen2.5-VL-7B 2026.04	-	-	-	-	-	-	-	-	-	-	37.81	-
Qwen2.5-VL-32B 2026.04	-	-	-	-	-	-	-	-	-	-	55.04	-
Qwen3-VL-A3B-30B 2026.04	-	-	-	-	-	-	-	-	-	-	57.17	-
Qwen3-VL-32B 2026.04	-	-	-	-	-	-	-	-	-	-	55.29	-
UniVG-R1-7B 2026.04	-	-	-	-	-	-	-	-	-	-	51.42	-
PR1-OCR-2B 2026.04	-	-	-	-	-	-	-	-	-	-	47.68	-
PR1-Detection-3B 2026.04	-	-	-	-	-	-	-	-	-	-	44.81	-
PR1-Counting-2B 2026.04	-	-	-	-	-	-	-	-	-	-	50.94	-
PR1-Grounding-2B 2026.04	-	-	-	-	-	-	-	-	-	-	53.83	-
DriveMM 2026.04	-	-	-	-	-	-	-	-	-	-	65.91	-
Cosmos-R1 2026.04	-	-	-	-	-	-	-	-	-	-	54.66	-
Mimo-Embodied 2026.04	-	-	-	-	-	-	-	-	-	-	40.31	-
XEmbodied 2026.04	-	-	-	-	-	-	-	-	-	-	77.01	-
DriveLMM-o1 2026.06	-	-	-	-	-	-	-	-	-	-	-	74.37
FastV 2026.06	-	-	-	-	-	-	-	-	-	-	-	69.56
SparseVLM 2026.06	-	-	-	-	-	-	-	-	-	-	-	69.4
Prune2Drive 2026.06	-	-	-	-	-	-	-	-	-	-	-	70.31
MVPruner 2026.06	-	-	-	-	-	-	-	-	-	-	-	72.91