| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| ARC Easy | BERT-Judge | Accuracy99.7 | 269 | 23d ago | |
| MMLU | M2CL | Accuracy97.5 | 222 | 26d ago | |
| HellaSwag | Stable-LoRA | Accuracy93.59 | 212 | 18d ago | |
| MMLU-Pro | BERT-Judge | MMLU-Pro Overall Accuracy96.5 | 138 | 1mo ago | |
| ARC Challenge | Acc74.7 | 133 | 2mo ago | ||
| IndoCulture native prompts (test) | Gemma2-9B | Accuracy67.5 | 99 | 4mo ago | |
| SciQ | QA | Accuracy100 | 91 | 2mo ago | |
| ArabCulture 1.0 (test) | Qwen2.5-7B | Accuracy59.6 | 84 | 4mo ago | |
| OBQA | ETN | Accuracy93.2 | 79 | 1mo ago | |
| MMLU 5-shot | EdgeJury | Accuracy73.4 | 73 | 3mo ago | |
| ARC Challenge (test) | PPT (Distribution) | Accuracy84.1 | 71 | 1mo ago | |
| ARC-Easy (test) | TaT | Accuracy89.1 | 68 | 4mo ago | |
| PIQA | Accuracy80.5 | 67 | 26d ago | ||
| World Knowledge Average of OBQA, ARC-C, ARC-E, SCIQ, SIQA | NTF | Average Accuracy87.1 | 66 | 1mo ago | |
| RACE | QA | Accuracy98.24 | 64 | 1mo ago | |
| OpenBookQA (test) | Clean | Accuracy91 | 61 | 1mo ago | |
| WinoG | Accuracy68.9 | 52 | 26d ago | ||
| MMLU | MMLU Accuracy (Overall)74.91 | 52 | 2mo ago | ||
| MMLU-PRO zero-shot | Gemini 2.0 Pro Exp | Accuracy84.29 | 51 | 2mo ago | |
| BoolQ | MC Accuracy0.887 | 50 | 26d ago | ||
| ARC Challenge | NoPE | Non-generative Accuracy30 | 48 | 2mo ago | |
| MC (test) | MC Avg78 | 46 | 4mo ago | ||
| PathMMU (val) | PathoSage | Overall Accuracy80.1 | 45 | 1mo ago | |
| GPQA | Accuracy (%)95.2 | 44 | 3mo ago | ||
| Arc-Easy v1 (test) | Accuracy83.21 | 43 | 1mo ago |
