Star
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Oriented Object Detection | STAR (test) | AP39.45 | 60 | |
| Video-based Question Answering | STAR | Accuracy78.6 | 50 | |
| Video Question Answering | STAR (test) | Interaction Score79.1 | 42 | |
| MAP Inference | STAR-dataset | Runtime0.02 | 25 | |
| Video Question Answering | STAR (val) | Mean Score63.8 | 22 | |
| Video Reasoning | STAR | Score67.7 | 19 | |
| Oriented Object Detection | STAR | AP5028.1 | 13 | |
| Statement Ranking | StaR Sports | Precision@55.547 | 12 | |
| Statement Ranking | StaR Beauty | Precision@56.2 | 12 | |
| Statement Ranking | StaR Clothes | Precision@515.136 | 12 | |
| Statement Ranking | StaR Toys | Precision@56.309 | 12 | |
| Selective Regression | star (test) | Conditional Large-Loss Rate28.5 | 12 | |
| Video Question Answering | STAR v1.0 (test) | Interaction Accuracy73.7 | 10 | |
| Video Question Answering | STAR V (test) | Accuracy42.8 | 10 | |
| Video Understanding | STAR | Score58.77 | 7 | |
| Regression | star (test) | Marginal Coverage91 | 7 | |
| Regression | star 2161 (test outliers) | Mean Outlier Coverage88 | 7 | |
| Regression | star | SMIS11.33 | 7 | |
| Regression | star n=2161 (test) | ILR1 | 7 | |
| Video Question Answering | STAR zero-shot (test) | Interaction Score51.5 | 7 | |
| Link Prediction | Star 1000 (test) | AUC100 | 5 | |
| Classification | Star | AUC0.886 | 2 |
Showing 22 of 22 rows