Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language Understanding on MMLU (0-shot and 5-shot)
Loading...
67.6
MMLU Accuracy (0-shot)
Yi-Chat
50.232
54.741
59.25
63.759
Mar 7, 2024
MMLU Accuracy (0-shot)
MMLU Accuracy (5-shot)
Updated 4d ago
Evaluation Results
Method
Method
Links
MMLU Accuracy (0-shot)
MMLU Accuracy (5-shot)
Yi-Chat
Size=34B
2024.03
67.6
73.5
Yi-Chat-8bits(GPTQ)
Size=34B
2024.03
66.2
73.7
Yi-Chat-4bits(AWQ)
Size=34B
2024.03
65.8
72.4
AquilaChat2
Size=34B
2024.03
65.2
66.7
Qwen-Chat
Size=14B
2024.03
64
65
LLaMA2-Chat
Size=70B
2024.03
59.4
59.9
Yi-Chat-8bits(GPTQ)
Size=6B
2024.03
58.3
61
Yi-Chat
Size=6B
2024.03
58.2
61
Yi-Chat-4bits(AWQ)
Size=6B
2024.03
56.8
59.9
InternLM-Chat
Size=20B
2024.03
55.6
57.4
Baichuan2-Chat
Size=13B
2024.03
55.1
50.1
LLaMA2-Chat
Size=13B
2024.03
50.9
47.3
Feedback
Search any
task
Search any
task