Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on PopQA (Score)

43.93Score

CDKC (w/ 2 round)

Updated 1mo ago

Evaluation Results

Method	Links
CDKC (w/ 2 round) 2026.02		43.93
RAG 2026.02		43.44
RAG 2026.02		42.73
CDKC 2026.02		40.33
GRPO 2026.02		37.33
Olmo 3 Think (DPO) 2025.12		37
BARREL 2026.02		35
Olmo 3 Think (SFT) 2025.12		33.1
Qwen 3 VL 32B Think 2025.12		32.2
K2-V2 70B Instruct 2025.12		32.2
Olmo 3 Think (Final 3.0) 2025.12		31.9
CDKC (w/ 2 round) 2026.02		31.67
Olmo 3.1 Think 32B 2025.12		30.9
Qwen 3 32B 2025.12		30.7
Vanilla SFT 2026.02		29.43
Qwen 3 VL 8B Think 2025.12		29.3
CRew-DPO 2026.02		28.97
Granite 3.3 8B Inst 2025.12		28.9
CDKC 2026.02		28.27
GRPO 2026.02		28.1
Know What 2026.02		26.97
DS-R1 32B 2025.12		26.7
CGKE 2026.02		26.6
Qwen 3 VL 8B Inst 2025.12		26.5
OLMo 2 7B Inst 2025.12		25.5
Apertus 8B Inst 2025.12		25.5
LLKD-SFT 2026.02		25.07
Olmo 3 7B Think 2025.12		24.7
CoT 2026.02		24.33
Qwen 3 8B 2025.12		24.3
Olmo 3 7B Think 2025.12		23.7
Qwen 2.5 7B 2025.12		21.5
BARREL 2026.02		20.97
Olmo 3 7B Think 2025.12		20.8
Olmo 3 7B Instruct 2025.12		20.7
Qwen 3 8B 2025.12		20.4
Vanilla LLM 2026.02		20.33
OpenThinker3 7B 2025.12		18
Nemotron Nano 9B v2 2025.12		17.9
CRew-DPO 2026.02		16.57
Know What 2026.02		16.53
Olmo 3 7B Instruct 2025.12		16.5
CGKE 2026.02		16.13
Vanilla SFT 2026.02		15.9
LLKD-SFT 2026.02		15.43
CoT 2026.02		15.07
OR Nemotron 7B 2025.12		14.5
Vanilla LLM 2026.02		14.5
Olmo 3 7B Instruct 2025.12		14.1
DS-R1 Qwen 7B 2025.12		12.8