Share your thoughts, 1 month free Claude Pro on usSee more

Language Modeling on WikiText and LAMBADA

7.3WikiText Perplexity

Llama3 8B

Updated 26d ago

Evaluation Results

Method	Links
Llama3 8B 2025.09		7.3	3.1
Qwen3 14B 2025.09		11	3.7
Qwen3 8B 2026.02		12	4.6
Qwen3 8B 2025.09		12	4.6
Llama3.2-1B 2026.02		12	5.7
ROCKET 2026.02		15	4.7
CoSpaDi 2025.09		16	3.4
CoSpaDi 2026.02		18	4.9
ROCKET 2026.02		18	4.4
CoSpaDi 2025.09		18	4.9
SVD-LLM 2025.09		18	4.1
MDN 2026.05		18.03	14.87
Comba 2026.05		18.37	15.17
GDN 2026.05		18.51	16.12
Transformer 2026.05		18.99	17.9
Mamba2 2026.05		19.14	18.2
KDA 2026.05		19.24	16.83
CoSpaDi 2025.09		20	4.3
CoSpaDi 2025.09		20	4.2
SVD-LLM 2026.02		21	6.4
SVD-LLM 2025.09		21	6.4
COMPOT 2026.02		21	14
CoSpaDi 2026.02		23	6.3
CoSpaDi 2025.09		23	6.3
SVD-LLM 2025.09		23	6.5
ROCKET 2026.02		24	5.9
COMPOT† 2026.02		25	21
SVD-LLM 2026.02		27	11
SVD-LLM 2025.09		27	11
MDN 2026.05		31.51	41.62
Comba 2026.05		31.73	46.19
KDA 2026.05		31.96	43.44
GDN 2026.05		32.1	45.63
Transformer 2026.05		32.8	54.36
CoSpaDi 2025.09		33	8.7
Mamba2 2026.05		33.45	60.42
ROCKET 2026.02		35	24
SVD-LLM 2025.09		35	18
CoSpaDi 2026.02		36	15
CoSpaDi 2025.09		36	15
COMPOT 2026.02		36	32
SVD-LLM 2025.09		41	11
SVD-LLM 2026.02		43	36
SVD-LLM 2025.09		43	36
CoSpaDi 2025.09		45	9.2
COMPOT† 2026.02		55	84
CoSpaDi 2026.02		59	41
CoSpaDi 2026.02		64	35
SVD-LLM 2026.02		76	88
COMPOT 2026.02		130	190
SVD-LLM 2025.09		150	61
SVD-LLM 2026.02		170	170
CoSpaDi 2025.09		180	120
COMPOT† 2026.02		280	2,200
CoSpaDi 2026.02		290	660
SVD-LLM 2025.09		550	1,300
SVD-LLM 2026.02		590	2,500
CoSpaDi 2026.02		800	9,200
SVD-LLM 2026.02		1,600	33,000