MMLU

Benchmarks

Task Name	Dataset Name	SOTA Result
Multi-task Language Understanding	MMLU	Accuracy99.7	881
Language Understanding	MMLU	Accuracy96.6	844
Multitask Language Understanding	MMLU	Accuracy91.5	568
Multi-task Language Understanding	MMLU	MMLU Accuracy98.5	456
General Knowledge	MMLU	MMLU General Knowledge Accuracy91.2	373
Multi-task Language Understanding	MMLU	Accuracy94.7	353
Multitask Language Understanding	MMLU (test)	Accuracy92.16	322
Language Understanding	MMLU	MMLU Accuracy90	307
Multitask Language Understanding	MMLU-Pro	Accuracy89.31	303
Reasoning	MMLU-Pro	Accuracy92.86	264
Multitask Language Understanding	MMLU	Accuracy86.3	263
Multiple-choice Question Answering	MMLU	Accuracy97.5	222
General Reasoning	MMLU-Pro	Accuracy82.3	213
Performance Estimation	MMLU	MAE0.002	198
General Reasoning	MMLU	MMLU Accuracy95.1	180
Knowledge	MMLU	Accuracy85.93	171
General Knowledge Evaluation	MMLU	MMLU Accuracy83.66	167
Language Understanding	MMLU (test)	MMLU Average Accuracy88	167
Language Understanding	MMLU 5-shot	Accuracy90.58	160
Language Understanding	MMLU 5-shot (test)	Accuracy74.2	149
Knowledge Reasoning	MMLU-Pro	Accuracy91.43	148
Language Understanding	MMLU	MMLU Accuracy87.56	144
Multi-task Language Understanding	MMLU	Accuracy83.29	143
Multiple Choice Question Answering	MMLU-Pro	MMLU-Pro Overall Accuracy96.5	138
Massive Multitask Language Understanding	MMLU	Accuracy83.34	137

Showing 25 of 993 rows

...