| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| HellaSwag | Falcon-180B | Accuracy87.5 | 440 | 25d ago | |
| COPA | T5(3B) + PE w/ ROE (ORC.) | Accuracy92.88 | 48 | 4mo ago | |
| HellaSwag 2019 | Normalized Accuracy80.12 | 26 | 1mo ago | ||
| HellaSwag (test) | Accuracy82.1 | 19 | 2mo ago | ||
| IndoCulture native prompts (test) | Qwen2.5-7B-IT | Avg Sentence Similarity42 | 18 | 4mo ago | |
| ArabCulture native prompts (test) | Qwen2.5-7B-IT | Avg Sentence Similarity44.7 | 18 | 4mo ago | |
| ArabCulture | Qwen2.5-7B-IT (+CCKG N-Asrt) | Sentence Similarity Score42.5 | 18 | 4mo ago | |
| IndoCulture | Qwen2.5-7B-IT (+CCKG N-Path) | Sentence Similarity Score43 | 18 | 4mo ago | |
| HellaSwag v1 (test) | Mistral-7B | Normalized Accuracy81 | 16 | 3mo ago | |
| StoryCloze | Accuracy90.8 | 11 | 29d ago | ||
| Reuters (test) | ARC-II | P@149.62 | 8 | 4mo ago | |
| KORANI Sentence Completion | mT-En-CI | Kobest Copa80.8 | 5 | 4mo ago | |
| P3 | COPA Accuracy85.3 | 5 | 4mo ago | ||
| HellaSwag 0-shot | Accuracy79.3 | 4 | 4mo ago | ||
| HellaSwag DE 10-shot (test) | T-Free | Normalized Log Accuracy68.7 | 3 | 4mo ago | |
| HellaSwag DE | HATified | Normalized Log Accuracy59.6 | 2 | 4mo ago | |
| Hellaswag | Flexora | Time (h)4.71 | 2 | 4mo ago |
