Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language understanding and knowledge on MMLU-Pro
Loading...
33.8
Accuracy
Full-Attn
13.936
19.093
24.25
29.407
Jul 15, 2024
Oct 17, 2024
Jan 20, 2025
Apr 25, 2025
Jul 28, 2025
Oct 31, 2025
Feb 3, 2026
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Full-Attn
# Shots=5-shot, Model...
2026.02
33.8
HySparse
# Shots=5-shot, Model...
2026.02
32.6
HySparse
# Shots=5-shot, Model...
2026.02
29
Hybrid SWA
# Shots=5-shot, Model...
2026.02
27.2
Full-Attn
# Shots=5-shot, Model...
2026.02
26.8
Hybrid SWA
# Shots=5-shot, Model...
2026.02
26.5
Qwen2-1.5B
# Non-Emb Params=1.2B
2024.07
21.8
Gemma-2B
# Non-Emb Params=2.0B
2024.07
15.9
Qwen2-0.5B
# Non-Emb Params=0.3B
2024.07
14.7
Feedback
Search any
task
Search any
task