Share your thoughts, 1 month free Claude Pro on usSee more

Natural Language Understanding on HellaSwag

85.6Accuracy

NLS

Updated 12d ago

Evaluation Results

Method	Links
NLS 2026.05		85.6
PrefixQ 2026.05		76.44
PrefixQ 2026.05		74.06
Fixed (p = 4) + SP 2026.05		59.7
Entropy-based + SP 2026.05		59.7
H-Net + SP 2026.05		59.6
SpaceByte + SP 2026.05		59.5
Fixed (p = 8) + SP 2026.05		59.2
H-Net 2026.05		58.5
Tokenizer-based 2026.05		58.4
Fixed (p = 16) + SP 2026.05		58
Fixed (p = 4) 2026.05		57.9
Entropy-based 2026.05		57.7
SpaceByte 2026.05		57.3
Byte-level 2026.05		55.1
Fixed (p = 8) 2026.05		54.5
SYNPRO 2026.05		49.17
Fixed (p = 16) 2026.05		47.3
Unique 2026.05		43.03
FT 2024.11		40.89
FT 2024.11		40.36
FT 2024.11		40.18
ProDiaL 2024.11		38.92
SYNPRO 2026.05		38.68
Strong 2024.11		38.66
LoRA 2024.11		38.46
ProDiaL 2024.11		38.41
LoRA 2024.11		38.33
Full-FT 2024.11		38.23
ProDiaL 2024.11		38.19
DoRA 2024.11		38.13
DoRA 2024.11		38.08
LoRA 2024.11		37.3
DoRA 2024.11		37.19
BitFit 2024.11		35.69