Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VILLAIN at AVerImaTeC: Verifying Image-Text Claims via Multi-Agent Collaboration

About

This paper describes VILLAIN, a multimodal fact-checking system that verifies image-text claims through prompt-based multi-agent collaboration. For the AVerImaTeC shared task, VILLAIN employs vision-language model agents across multiple stages of fact-checking. Textual and visual evidence is retrieved from the knowledge store enriched through additional web collection. To identify key information and address inconsistencies among evidence items, modality-specific and cross-modal agents generate analysis reports. In the subsequent stage, question-answer pairs are produced based on these reports. Finally, the Verdict Prediction agent produces the verification outcome based on the image-text claim and the generated question-answer pairs. Our system ranked first on the leaderboard across all evaluation metrics. The source code is publicly available at https://github.com/ssu-humane/VILLAIN.

Jaeyoon Jung, Yejun Yoon, Kunwoo Park• 2026

Related benchmarks

TaskDatasetResultRank
Multimodal Claim VerificationAVerImaTeC (dev)
Q-Eval92.3
4
Verdict PredictionAVerImaTeC official (test)
Q-Eval89
4
Showing 2 of 2 rows

Other info

Follow for update