Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understanding

About

Current multimodal reflection mechanisms for long video understanding predominantly rely on closed-loop self-reflection within internal parameters. Lacking objective external evidence, models are frequently trapped in blind confidence and often fail to correct errors. Furthermore, applying reinforcement learning to multi-stage reflection pipelines introduces severe policy coupling, which is exacerbated by a critical scarcity of dedicated training data. To address these limitations, this work proposes Reflect-R1, the first Evidence-Driven self-correction framework for long video understanding. The framework constructs a three-stage pipeline consisting of intuition, verification, and arbitration. By dynamically retrieving objective visual evidence to verify initial intuitions and autonomously executing multiple temporal searches to resolve conflicts, it completely breaks the hallucination loop. To overcome policy coupling, we design a stage-decoupled reinforcement learning algorithm named SD-GRPO that independently computes advantage functions across different reasoning stages. Concurrently, we construct a dataset of 120K samples to bridge the training data gap. Extensive experiments on benchmarks such as VideoMME and LongVideoBench demonstrate that Reflect-R1 achieves state-of-the-art performance. Our method significantly improves the genuine rectification rate and enables authentic self-correction strictly grounded in objective evidence.

Shuimu Chen, Yuteng Chen, Yuanshen Guan, Zebang Cheng, Zeyu Zhang, Shengqian Qin, Bin Xia, Jiaran Li, Wenming Yang, Fei Ma• 2026

Related benchmarks

TaskDatasetResultRank
Video UnderstandingVideo-MME without subtitles
Overall Score63.5
145
Temporal SearchLVBench Haystack
Temporal Precision6.3
10
Long Video UnderstandingLongVideoBench (LVB) (val)
Accuracy62.5
8
Long Video UnderstandingMLVU m-avg
MLVU m-avg Score69.8
7
Question AnsweringLVBench Haystack
LVBench Score55.5
7
Showing 5 of 5 rows

Other info

Follow for update