Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AITP: Traffic Accident Responsibility Allocation via Multimodal Large Language Models

About

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in Traffic Accident Detection (TAD) and Traffic Accident Understanding (TAU). However, existing studies mainly focus on describing and interpreting accident videos, leaving room for deeper causal reasoning and integration of legal knowledge. Traffic Accident Responsibility Allocation (TARA) is a more challenging task that requires multi-step reasoning grounded in traffic regulations. To address this, we introduce AITP (Artificial Intelligence Traffic Police), a multimodal large language model for responsibility reasoning and allocation. AITP enhances reasoning via a Multimodal Chain-of-Thought (MCoT) mechanism and integrates legal knowledge through Retrieval-Augmented Generation (RAG). We further present DecaTARA, a decathlon-style benchmark unifying ten interrelated traffic accident reasoning tasks with 67,941 annotated videos and 195,821 question-answer pairs. Extensive experiments show that AITP achieves state-of-the-art performance across responsibility allocation, TAD, and TAU tasks, establishing a new paradigm for reasoning-driven multimodal traffic analysis.

Zijin Zhou, Songan Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Causal ReasoningAITP 1.0 (test)
BLEU0.0382
5
Prevention ReasoningAITP 1.0 (test)
BLEU0.0441
5
Traffic Accident Responsibility AllocationAITP 1.0 (test)
Accident Metric72.18
5
Traffic Scene DescriptionAITP 1.0 (test)
BLEU0.0395
5
Spatial LocationAITP 1.0 (test)
AP@3065.27
4
Temporal LocationAITP 1.0 (test)
AP@358.25
4
Showing 6 of 6 rows

Other info

Follow for update