Share your thoughts, 1 month free Claude Pro on usSee more

Agentic Search on MuSiQue

32.5String F1 Score

Vanilla-Qwen3-32B

Updated 11d ago

Evaluation Results

Method	Links
Vanilla-Qwen3-32B 2026.04		32.5	-	-	-
Vanilla-Qwen3-8B 2026.04		32	-	-	-
SFT-Qwen3-1.7B 2026.04		29.2	-	-	-
Vanilla-Qwen3-4B 2026.04		28.7	-	-	-
OPD-Qwen3-1.7B 2026.04		28.6	-	-	-
Mixed-Qwen3-1.7B 2026.04		27.2	-	-	-
Distilled-Qwen3-1.7B 2026.04		25.4	-	-	-
Vanilla-Qwen3-1.7B 2026.04		22.9	-	-	-
SFT-Qwen3-0.6B 2026.04		22.7	-	-	-
SFT-Llama-3.2-1B 2026.04		22.3	-	-	-
Distilled-Llama3.2-3B 2026.04		20.6	-	-	-
Distilled-Llama3.2-1B 2026.04		15.9	-	-	-
SFT-Llama-3.2-3B 2026.04		14.4	-	-	-
Vanilla-Qwen3-0.6B 2026.04		8.7	-	-	-
No-thinking 2025.12		-	4.2	6	3
Thinking 2025.12		-	5.8	8.6	3.4
RAG 2025.12		-	9	10.8	7.4
ReAct 2025.12		-	19.4	24.6	14.6
Search-R1 2025.12		-	10.4	14.6	7.6
Laser 2025.12		-	22.4	28.2	20.4
No-thinking 2025.12		-	7.8	11.2	5.8
Thinking 2025.12		-	10.6	14	7.8
RAG 2025.12		-	12.2	14	10
ReAct 2025.12		-	22	26.8	15.2
Search-R1 2025.12		-	17.6	22.2	11.4
Laser 2025.12		-	24.2	31.6	22