Share your thoughts, 1 month free Claude Pro on usSee more

Language Understanding on MMLU (5-shot)

90.58Accuracy

ERNIE 5.0-Base

Updated 29d ago

Evaluation Results

Method
ERNIE 5.0-Base 2026.02	90.58	-	-	-	-	-	-	-
DS V3.2-Exp-Base 2026.02	88.6	-	-	-	-	-	-	-
Kimi K2-Base 2026.02	88.4	-	-	-	-	-	-	-
Dream-v0-7B-Instruct 2026.05	73.34	-	-	-	-	-	9.97	1
dLLM-Cache 2026.05	73.08	-	-	-	-	-	19.44	1.95
dKV-Cache 2026.05	72.93	-	-	-	-	-	16.75	1.68
Fast-dLLM 2026.05	72.14	-	-	-	-	-	18.74	1.88
Dynamic-dLLM 2026.05	72.1	-	-	-	-	-	31.31	3.14
Dynamic-dLLM 2026.05	72.09	-	-	-	-	-	25.82	2.59
Fast-dLLM 2026.05	71.97	-	-	-	-	-	30.11	3.02
fp16 2026.02	69.2	65.2	58.3	80.5	75.2	-	-	-
OmniQuant 2026.02	67.3	64.1	55.2	78.5	73.1	-	-	-
Astro 2026.02	66.9	64.2	54.7	77.9	72.2	-	-	-
MagR 2026.02	66.1	63	53.9	77	72.4	-	-	-
FP16 2026.02	65.3	59.8	56	76.4	72.2	-	-	-
FP16 2026.04	65.3	-	-	-	-	-	-	-
COVERCAL 2026.04	64.6	-	-	-	-	-	-	-
Max-ActVar 2026.04	63.8	-	-	-	-	-	-	-
Stratified 2026.04	63.5	-	-	-	-	-	-	-
Max-PPL 2026.04	63.4	-	-	-	-	-	-	-
Random 2026.04	63.1	-	-	-	-	-	-	-
LORA 2024.02	62.9	-	-	-	-	-	-	-
Pre-trained 2024.02	62.6	-	-	-	-	-	-	-
FP16 2026.04	62.5	-	-	-	-	-	-	-
COVERCAL 2026.04	62	-	-	-	-	-	-	-
L4Q 2024.02	61.4	-	-	-	-	-	-	-
Max-ActVar 2026.04	61.3	-	-	-	-	-	-	-
Stratified 2026.04	61.1	-	-	-	-	-	-	-
Max-PPL 2026.04	61	-	-	-	-	-	-	-
Random 2026.04	60.8	-	-	-	-	-	-	-
LORA 2024.02	57.6	-	-	-	-	-	-	-
L4Q 2024.02	56.7	-	-	-	-	-	-	-
Pre-trained 2024.02	56.4	-	-	-	-	-	-	-
32-bit AdamW 2023.09	56.4	-	-	-	-	-	-	-
Astro 2026.02	56.3	50.4	49.7	65.6	62.6	-	-	-
L4Q 2024.02	56.2	-	-	-	-	-	-	-
L4Q 2024.02	56.2	-	-	-	-	-	-	-
OmniQ 2024.02	55.9	-	-	-	-	-	-	-
FP16 2024.06	55.78	51.97	44.96	65.26	62.4	-	-	-
LORA 2024.02	55.7	-	-	-	-	-	-	-
LLaMA2-13b 2024.05	55.7	62.9	44.4	63.9	56.7	-	-	-
fp16 2026.02	55.4	53.8	44.4	63.5	61.3	-	-	-
L4Q 2024.02	55.2	-	-	-	-	-	-	-
Original LLaMA 2023.09	54.9	-	-	-	-	-	-	-
4-bit AdamW 2023.09	54.9	-	-	-	-	-	-	-
GPTQ 2024.05	54.9	61.3	43.3	62.5	57.2	-	-	-
Pre-trained 2024.02	54.8	-	-	-	-	-	-	-
QA-LoRA 2024.05	54.2	59.6	42.7	62.2	57.4	-	-	-
QAT-LORA 2024.02	54	-	-	-	-	-	-	-
QLORA 2024.02	53.6	-	-	-	-	-	-	-
LLM-QFA 2024.05	53.4	59.1	42.1	61.1	56.2	-	-	-
L4Q 2024.02	53.1	-	-	-	-	-	-	-
L4Q 2024.02	53.1	-	-	-	-	-	-	-
OmniQ 2024.02	52.4	-	-	-	-	-	-	-
Astro 2026.02	52.2	48.5	43.1	60.4	58.8	-	-	-
DuQuant 2024.06	51.96	48.78	40.92	60.42	57.71	-	-	-
GPTQ 2024.02	51.9	-	-	-	-	-	-	-
MagR 2026.02	51.9	46.1	46.1	59.7	58.9	-	-	-
LLM-QFA 2024.05	51.8	56.7	40.6	59.9	54.5	-	-	-
QA-LORA 2024.02	51.7	-	-	-	-	-	-	-
QA-LoRA 2024.05	51.7	56.8	41.9	59	53.5	-	-	-
OmniQuant 2026.02	51.7	45.9	45.5	59.3	59.1	-	-	-
DuQuant+LWC 2024.06	51.61	48.52	41.42	58.73	57.74	-	-	-
MagR 2026.02	51.2	48.5	42.2	58.3	57.3	-	-	-
OmniQuant 2026.02	51	47.5	42.8	58.8	56.9	-	-	-
QAT-LORA 2024.02	50.6	-	-	-	-	-	-	-
QLORA 2024.02	50.6	-	-	-	-	-	-	-
GPTQ 2024.02	50.4	-	-	-	-	-	-	-
OmniQ 2024.02	50.2	-	-	-	-	-	-	-
QLORA 2024.02	50.1	-	-	-	-	-	-	-
L4Q 2024.02	50	-	-	-	-	-	-	-
L4Q 2024.02	50	-	-	-	-	-	-	-
QA-LORA 2024.02	49.9	-	-	-	-	-	-	-
GPTQ 2024.02	49.6	-	-	-	-	-	-	-
QAT-LORA 2024.02	48.9	-	-	-	-	-	-	-
QA-LORA 2024.02	48.7	-	-	-	-	-	-	-
Original LLaMA 2023.09	47.4	-	-	-	-	-	-	-
4-bit AdamW 2023.09	47.4	-	-	-	-	-	-	-
LORA 2024.02	47	-	-	-	-	-	-	-
LLAMA 2023.05	46.9	-	-	-	-	-	-	-
LLaMA2-7b 2024.05	46.8	51.6	37.3	52.2	49.9	-	-	-
32-bit AdamW 2023.09	46.5	-	-	-	-	-	-	-
Pre-trained 2024.02	46.3	-	-	-	-	-	-	-
LLM-QFA 2024.05	46.1	-	-	-	-	-	-	-
LORA 2024.02	46	-	-	-	-	-	-	-
L4Q 2024.02	46	-	-	-	-	-	-	-
FP16 2026.04	46	-	-	-	-	-	-	-
fp16 2026.02	45.9	43	37.4	51.9	53.2	-	-	-
QA-LoRA 2024.05	45.8	-	-	-	-	-	-	-
L4Q 2024.02	45.5	-	-	-	-	-	-	-
Pre-trained 2024.02	45.4	-	-	-	-	-	-	-
COVERCAL 2026.04	45.4	-	-	-	-	-	-	-
GPTQ 2024.05	45.1	50.5	36.9	50.5	47.5	-	-	-
QA-LoRA 2024.05	45.1	49.8	36.8	49.8	47.8	-	-	-
Atom 2024.06	45.01	39.21	35.35	59.72	45.77	-	-	-
Max-ActVar 2026.04	44.8	-	-	-	-	-	-	-
Stratified 2026.04	44.6	-	-	-	-	-	-	-
Max-PPL 2026.04	44.5	-	-	-	-	-	-	-
Random 2026.04	44.2	-	-	-	-	-	-	-
LLM-QFA 2024.05	44	48.4	35.6	48.1	46.9	-	-	-

Showing 100 of 226 rows