Share your thoughts, 1 month free Claude Pro on usSee more

CommonSense Reasoning on Wino

86.55Accuracy

FFT

Updated 21d ago

Evaluation Results

Method	Links
FFT 2025.09		86.55
ABBA 2025.09		86.53
BoHA 2025.09		86.4
HiRA 2025.09		85.71
GraLoRA 2025.09		84.98
DoRA 2025.09		84.14
LoRA 2025.09		83.5
PiSSA 2025.09		83.24
rsLoRA 2025.09		82.02
Full-precision 2026.04		77.4
Full-precision 2026.04		76.4
PMQ 2026.04		75.3
Uniform 2026.04		75.14
Router norm + Max var 2026.04		74.98
PMQ 2026.04		74.98
FFT 2025.09		74.79
ABBA 2025.09		74.74
Router norm + Max var 2026.04		74.66
PMQ 2026.04		74.66
PMQ 2026.04		74.66
Router norm + Max var 2026.04		74.35
PMQ 2026.04		74.19
PiSSA 2025.09		74.03
Router norm + Max var 2026.04		73.95
GraLoRA 2025.09		73.95
rsLoRA 2025.09		73.85
Router norm + Max var 2026.04		73.8
BoHA 2025.09		73.59
PMQ 2026.04		73.24
DoRA 2025.09		73.01
Hessian 2026.04		72.97
LoRA 2025.09		72.38
PMQ 2026.04		72.3
HiRA 2025.09		71.27
Hessian 2026.04		71.25
PMQ 2026.04		71.19
Router norm + Max var 2026.04		70.17
Router norm + Max var 2026.04		69.93
Hessian 2026.04		69.11
SSQR-4% 2025.07		68.9
BF16 Baseline 2025.07		68.75
EMoE 2025.09		68.51
HPTQ 2025.07		68.35
SSQR-5% 2025.07		68.35
Router norm + Max var 2026.04		68.35
SSQR-3% 2025.07		68.27
EMoE 2025.09		68.27
SSQR-1% 2025.07		68.19
Uniform 2026.04		68.19
GPTQ 2025.07		68.11
HPTQ 2025.07		68.03
SSQR-2% 2025.07		68.03
Top-k 2025.09		67.09
SSQR-1% 2025.07		66.93
Top-k 2025.09		66.93
SSQR-4% 2025.07		66.77
SSQR-3% 2025.07		66.69
SSQR-5% 2025.07		66.69
GPTQ 2025.07		66.06
PCMind-2.1-Kaiyuan-2B 2025.12		65.75
SSQR-2% 2025.07		65.51
Qwen3-4B 2025.12		65.43
Router norm + Max var 2026.04		65.43
gemma2-2B 2025.12		65.35
PMQ 2026.04		65.35
EMoE 2025.09		65.35
Uniform 2026.04		65.27
SmolLM3-3B 2025.12		64.4
Router norm + Max var 2026.04		64.4
Top-k 2025.09		64.17
llama-3.2-3B 2025.12		64.09
Llama-3.1 2026.01		63.9
Qwen2.5-3B 2025.12		63.69
BSP 2026.04		62.19
PMQ 2026.04		61.96
YuLan-Mini-2.4B 2025.12		61.88
Router norm + Max var 2026.04		61.25
HPTQ 2025.07		60.85
OLMo-2-0425-1B 2025.12		60.38
A3 2026.01		60.2
Qwen2-1.5B 2025.12		59.83
PMQ 2026.04		59.83
Qwen2.5-1.5B 2025.12		59.67
Router norm + Max var 2026.04		59.59
Qwen3-1.7B 2025.12		59.27
6-LOOP 2025.12		59.19
SmolLM2-1.7B 2025.12		59.12
MOE 2025.12		58.8
SSQR-3% 2025.07		58.48
VERSATILEFFN 2025.12		58.17
llama-3.2-1B 2025.12		58.17
4-LOOP 2025.12		57.87
SSQR-4% 2025.07		57.85
Slim-LLM 2026.04		57.54
2-LOOP 2025.12		57.38
SSQR-5% 2025.07		57.38
PMQ 2026.04		57.38
Top-k 2025.09		57.22
Top-k 2025.09		57.22
EMoE 2025.09		56.99

Showing 100 of 146 rows