| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| NOVA OOD | Lingshu-32B | METEOR18.43 | 14 | 1mo ago | |
| Our Benchmark | BrReMark | METEOR23.64 | 14 | 1mo ago | |
| COCO 2017 (val) | HeteroServe | Throughput (tok/s)4,633 | 6 | 4mo ago | |
| Image Description tasks | VOLMO-2B | ROUGE-L F121.7 | 5 | 4mo ago | |
| Image description | VOLMO-2B | BLEU-10.1741 | 5 | 4mo ago | |
| NOVA | Gemini 2.0 Flash | BLEU-41.83 | 3 | 1mo ago |
