Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

StreamReady: Learning What to Answer and When in Long Streaming Videos

About

Streaming video understanding often involves time-sensitive scenarios where models need to answer exactly when the supporting visual evidence appears: answering before the evidence reflects speculation, answering after it has passed reduces real-time utility. To capture this behavior, we introduce a readiness-aware formulation of streaming video understanding with the Answer Readiness Score (ARS), a timing-aware objective with asymmetric early and late penalties. When combined with correctness, ARS defines an effective accuracy that measures not just whether a model is right, but whether it answers at the appropriate moment. Building on this formulation, we introduce StreamReady, a framework to unify temporal reasoning with on-time answering through a lightweight readiness mechanism that decides if sufficient evidence has been observed before responding. To evaluate this capability, we further introduce ProReady-QA, a benchmark with annotated answer evidence windows and proactive multi-turn questions across local and global contexts. StreamReady achieves superior performance on ProReady-QA, and consistently outperforms prior methods across eight additional streaming and offline long-video benchmarks, demonstrating robust and broadly generalizable video understanding capability.

Shehreen Azad, Vibhav Vineet, Yogesh Singh Rawat• 2026

Related benchmarks

TaskDatasetResultRank
Streaming Video UnderstandingStreamingBench
Overall63.4
158
Long Video UnderstandingVideoMME
Accuracy65.8
40
Streaming Video UnderstandingOVOBench
Accuracy (Proactive Forwarding)58.8
17
Streaming Video UnderstandingOVBench Non-Proactive
Average63.9
15
Readiness-aware streaming understandingProReady-QA
SSR Accuracy74.3
14
Dense Video CaptioningE.T.Bench--
14
Streaming Video Question AnsweringVStream-QA (test)
RE64.8
6
Step Localization and CaptioningET-Bench
F1 Score24.1
4
Temporal Video GroundingET-Bench
F1-score36.8
4
Showing 9 of 9 rows

Other info

Follow for update