Massive Multitask Language Understanding on MMLU (Performance Profile)
56.6MMLU
Qwen3-4B + FBS-Full (ours)
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.01 | 56.6 | 532 | 0.7 | 36 | |
2026.01 | 56.4 | 755 | 1.03 | 0 | |
2026.01 | 55.1 | 760 | 1 | 0 | |
2026.01 | 55 | 555 | 0.74 | 30 | |
| 55 | 595 | 0.82 | 15 | ||
2026.01 | 54.9 | 646 | 0.9 | 22 | |
2026.01 | 54.7 | 570 | 0.8 | 18 | |
2026.04 | 46.1 | - | - | - | |
2026.04 | 45.7 | - | - | - | |
2026.04 | 45.3 | - | - | - | |
2026.04 | 45.2 | - | - | - | |
2026.04 | 45.1 | - | - | - | |
2026.04 | 45 | - | - | - | |
2026.04 | 44.9 | - | - | - | |
2026.04 | 44.8 | - | - | - | |
2026.04 | 44.5 | - | - | - |