Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding

About

The dominant paradigm in video retrieval relies on embedding-based full-corpus scanning, which suffers from inherent computational inefficiency and the semantic asymmetry between information-dense videos and sparse textual queries. To bridge this gap, we introduce \textbf{MAVIS}, a novel multi-agent framework that rethinks retrieval as cooperative reasoning rather than brute-force search. MAVIS first bridges the granularity mismatch by parsing raw videos into a \textbf{Structured Semantic Library}, enabling explicit attribute-level indexing. During retrieval, a planner decomposes complex user intents into atomic sub-tasks, dispatching specialized agents to independently nominate candidates. Crucially, MAVIS employs a \textbf{Logic-aware Debate} mechanism with a strict veto protocol, where agents collaboratively prune logical mismatches to identify a compact set of ``controversial'' candidates for fine-grained verification. This agentic workflow effectively bypasses the inefficiency of full-library traversal. Extensive experiments on MSR-VTT, MSVD, and ActivityNet demonstrate that MAVIS achieves competitive performance without task-specific fine-tuning, offering a scalable and interpretable alternative to traditional dual-encoder approaches.

Jie Zhang, Qilang Ye, Hao Zhou, Haochen Liang, Fei Luo• 2026

Related benchmarks

TaskDatasetResultRank
Video-to-Text retrievalActivityNet
R@10.6915
160
Video-Text RetrievalMSVD
R@178.1
43
Video-Text RetrievalMSR-VTT
R@178.6
34
Showing 3 of 3 rows

Other info

Follow for update