Share your thoughts, 1 month free Claude Pro on usSee more

Instruction Following on AlpacaEval LC 2

80.9Win Rate

Qwen 3 VL 32B Think

Updated 16d ago

Evaluation Results

Method	Links
Qwen 3 VL 32B Think 2025.12		80.9
Olmo 3 Think (DPO) 2025.12		78.6
Qwen 3 32B 2025.12		75.6
Olmo 3 Think (Final 3.0) 2025.12		74.2
Multi-DPOP 2025.10		69.7
Olmo 3 Think (SFT) 2025.12		69.1
Olmo 3.1 Think 32B 2025.12		69.1
GRPO 2025.10		68.9
DPO 2025.10		68.5
Base 2025.10		67.4
SFT 2025.10		65.3
Multi-DPOP 2025.10		64.2
GRPO 2025.10		63.8
DPO 2025.10		63.5
Base 2025.10		62.3
SFT 2025.10		60.7
Multi-DPOP 2025.10		58.4
GRPO 2025.10		57.5
DPO 2025.10		57.2
Base 2025.10		56.2
SFT 2025.10		54.5
Qwen3-4B (Non-thinking) 2026.05		53.5
Qwen3-4B-GRLO+RLVR 2026.05		51.1
Qwen3-4B-GRLO 2026.05		45.8
Multi-DPOP 2025.10		43.1
GRPO 2025.10		42.8
DPO 2025.10		42.5
Base 2025.10		41.2
SFT 2025.10		39.8
PROSPER-JC 2026.02		38.21
PROSPER 2026.02		37.61
Multi-DPOP 2025.10		36.9
DPO 2025.10		36.7
GRPO 2025.10		36.3
Base 2025.10		34.5
Llama3.2-3B-GRLO+RLVR 2026.05		33.9
PROSPER-VB 2026.02		33.64
SFT 2025.10		33.1
Llama3.2-3B-GRLO 2026.05		31.5
General-Reasoner-4B 2026.05		30.8
DS-R1 32B 2025.12		26.2
Qwen2.5-7B-Instruct 2026.02		25.32
Llama3.2-3B-Instruct 2026.05		22.9
RLCF 2026.02		17.24
Llama3.2-3B-SFT 2026.05		8.5
Llama3.2-3B-RLVR 2026.05		8.1
Qwen3-4B-OpenSFT 2026.05		7.6
Qwen3-4B-MathSFT 2026.05		7.3
Qwen3-4B-Base 2026.05		1.6