| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| UniICL-Bench | UniICL | Perception Score80.9 | 33 | 4mo ago | |
| MMMU | Qwen2.5-VL-32B | MMMU Score75.1 | 20 | 4mo ago | |
| C3 | Score68.94 | 20 | 4mo ago | ||
| XSum | Score46.76 | 20 | 4mo ago | ||
| RACE Middle | Score67.27 | 20 | 4mo ago | ||
| MathVista | Qwen2.5-VL-32B | MathVista Score84.7 | 12 | 4mo ago | |
| EventDrive Hard | EventDrive-VLM | Accuracy59.04 | 9 | 1mo ago | |
| EventDrive | EventDrive-VLM | Accuracy65.46 | 9 | 1mo ago | |
| Algospeak Phonetic strategy | Threshold x0 (IMUM@0.5)6 | 7 | 2mo ago | ||
| Algospeak Code strategy | Estimated Threshold x0 (IMUM@0.5)1.1699 | 7 | 2mo ago | ||
| Algospeak Paraphrase strategy | Estimated Threshold x0 (IMUM@0.5)2.7983 | 7 | 2mo ago | ||
| Algospeak Emotion strategy | Estimated Threshold x0 (IMUM@0.5)4.3287 | 7 | 2mo ago | ||
| Algospeak Abbreviation strategy | Estimated Threshold x0 (IMUM@0.5)6 | 7 | 2mo ago | ||
| Algospeak New word strategy | Estimated Threshold x0 (IMUM@0.5)6 | 7 | 2mo ago | ||
| Algospeak Unknown word strategy | Estimated Threshold x0 (IMUM@0.5)6 | 7 | 2mo ago |