Multistep Reasoning on MUSR (Accuracy)

61.67Accuracy

Base

Updated 9d ago

Evaluation Results

Method	Links
Base 2025.05		61.67
Qwen2.5-14B (Teacher) 2026.02		60.8
Qwen2.5-14B 2026.02		60.8
Sigmoid capability boundaries 2026.02		53.5
Instruct 2025.10		50.13
GIFT 2025.10		49.47
GRPO 2025.10		48.68
GIFT 2025.10		46.16
GRPO 2025.10		45.77
Instruct 2025.10		42.86
TSD-KD 2026.02		39.6
TSD-KD 2026.02		39.4
Qwen2.5-1.5B (Student) 2026.02		38.7
DistiLLM 2026.02		38.7
Qwen2.5-1.5B 2026.02		38.7
DistiLLM 2026.02		38.7
GKD 2026.02		38.5
GKD 2026.02		38.5
MiniLLM 2026.02		38.3
MiniLLM 2026.02		38.3
Supervised-KD 2026.02		37.9
Supervised-KD 2026.02		37.9
Speculative KD 2026.02		37.7
Speculative KD 2026.02		37.7
Sequence-Level KD 2026.02		36.6
Sequence-Level KD 2026.02		36.6
Vanilla LoRA 2025.05		32.31
Base 2025.05		30.95
SHE-LoRA 2025.05		30.71
Vanilla LoRA 2025.05		18.05
SHE-LoRA 2025.05		17.86