Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Language Modeling on Wikitext (PPL)

12.85Wikitext PPL

Hybrid Gated DeltaNet + M2RNN-5

-5,101.44429,420.040563,941.52598,463.0095Apr 29, 2025Jun 28, 2025Aug 28, 2025Oct 28, 2025Dec 27, 2025Feb 26, 2026Apr 28, 2026
Updated 9d ago

Evaluation Results

MethodLinks
2026.03
12.85
2026.03
13
2026.03
13.01
2026.03
13.02
2026.03
13.07
2026.03
13.1
2026.03
13.51
2026.03
13.73
2026.03
13.8
2026.03
13.89
2026.03
14.8
2026.03
14.94
2025.04
15.1
2025.04
15.1
2025.04
15.1
2025.04
15.1
2025.04
15.84
2026.03
17.65
2025.04
17.86
2025.04
17.86
2025.04
17.86
2025.04
17.87
2025.11
17.93
2025.11
18.39
2025.11
18.44
2025.04
18.46
2025.11
18.61
2025.11
18.82
2025.04
19.24
2025.11
19.28
2025.11
19.6
2026.03
21.26
2026.03
21.39
2026.03
21.39
2026.03
21.48
2026.03
21.53
2026.03
21.59
2025.04
21.77
2026.03
21.89
2026.03
22.7
2026.03
22.92
2026.03
22.93
2026.03
23.32
2025.04
23.84
2025.04
23.85
2025.04
23.95
2025.04
24.31
2025.04
24.32
2025.04
24.4
2025.04
25.53
2025.04
25.69
2026.04
25.75
2026.03
25.8
2025.04
26.38
2025.04
26.47
2025.04
30.24
2025.04
31.53
2026.04
32.28
2026.04
32.83
2026.04
33.57
2026.03
33.74
2026.04
34.28
2025.04
34.57
2025.04
35.52
2026.04
36.46
2026.04
36.48
2026.04
37.82
2026.04
39.42
2026.04
41.1
2026.04
50.86
2026.04
50.86
2026.03
57
2026.03
58
2026.03
58.8
2026.03
62
2026.03
70.4
2026.03
79
2026.03
81.6
2026.03
82.9
2026.03
88.1
2026.03
92.1
2025.04
893.35
2025.04
2,139.86
2025.04
3,362.22
2025.04
4,081.76
2025.04
4,660.08
2025.04
127,870.2