StreamReady: Learning What to Answer and When in Long Streaming Videos
About
Streaming video understanding often involves time-sensitive scenarios where models need to answer exactly when the supporting visual evidence appears: answering before the evidence reflects speculation, answering after it has passed reduces real-time utility. To capture this behavior, we introduce a readiness-aware formulation of streaming video understanding with the Answer Readiness Score (ARS), a timing-aware objective with asymmetric early and late penalties. When combined with correctness, ARS defines an effective accuracy that measures not just whether a model is right, but whether it answers at the appropriate moment. Building on this formulation, we introduce StreamReady, a framework to unify temporal reasoning with on-time answering through a lightweight readiness mechanism that decides if sufficient evidence has been observed before responding. To evaluate this capability, we further introduce ProReady-QA, a benchmark with annotated answer evidence windows and proactive multi-turn questions across local and global contexts. StreamReady achieves superior performance on ProReady-QA, and consistently outperforms prior methods across eight additional streaming and offline long-video benchmarks, demonstrating robust and broadly generalizable video understanding capability.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Streaming Video Understanding | StreamingBench | Overall63.4 | 158 | |
| Long Video Understanding | VideoMME | Accuracy65.8 | 40 | |
| Streaming Video Understanding | OVOBench | Accuracy (Proactive Forwarding)58.8 | 17 | |
| Streaming Video Understanding | OVBench Non-Proactive | Average63.9 | 15 | |
| Readiness-aware streaming understanding | ProReady-QA | SSR Accuracy74.3 | 14 | |
| Dense Video Captioning | E.T.Bench | -- | 14 | |
| Streaming Video Question Answering | VStream-QA (test) | RE64.8 | 6 | |
| Step Localization and Captioning | ET-Bench | F1 Score24.1 | 4 | |
| Temporal Video Grounding | ET-Bench | F1-score36.8 | 4 |