StreamingBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Streaming Video Understanding | StreamingBench | Overall93.55 | 259 | |
| Real-time Visual Understanding | StreamingBench | Overall Score91.46 | 134 | |
| Real-Time Visual Understanding | StreamingBench Real-Time Visual Understanding (test) | OP89.5 | 33 | |
| Online Video Question Answering | StreamingBench | Overall Performance (OP)84.47 | 20 | |
| Real-time Streaming | StreamingBench | RTVU79.3 | 15 | |
| Online VideoQA | StreamingBench 1.0 (test) | Real-Time Score82.9 | 14 | |
| Streaming Video Reasoning | StreamingBench Real-Time | Object Perception (OP)89.47 | 14 | |
| Online Video Understanding | StreamingBench Real-Time | Real-Time Score77.3 | 13 | |
| Visual-Only Question Answering | StreamingBench Visual-Only QA 1.0 (test) | OP92.6 | 11 | |
| Proactive Alerting | StreamingBench | Precision41.73 | 11 | |
| Question Answering | StreamingBench | OP80.38 | 11 | |
| Reactive Question Answering | StreamingBench excluding PO 1.0 (test) | Overall Performance (OP)76.96 | 9 | |
| Streaming Video Understanding | StreamingBench Real-time | Score76 | 8 | |
| Streaming video understanding | StreamingBench proactive | Accuracy82.8 | 8 | |
| Proactive Response | StreamingBench | Accuracy38 | 7 | |
| Audio-Visual Question Answering | StreamingBench Audio-Visual QA 1.0 (test) | Error Rate (ER)40.4 | 6 | |
| Streaming Video Question Answering | StreamingBench Real-Time (test) | OP74 | 6 | |
| Retrospective VideoQA | StreamingBench Real-time | Top-1 Accuracy79.9 | 6 | |
| Online Video Understanding | StreamingBench | Real-time VU Score77.3 | 6 |
Showing 19 of 19 rows