Share your thoughts, 1 month free Claude Pro on usSee more

Knowledge-Intensive Reasoning on MuSiQue (F1 score)

34.8F1 Score

Llama3.1-8B + ARPO

Updated 1mo ago

Evaluation Results

Method	Links
Llama3.1-8B + ARPO 2025.12		34.8
Qwen2.5-7B + ARPO 2025.12		31.1
Llama3.1-8B + GRPO 2025.12		31
Qwen2.5-7B + GRPO 2025.12		30.6
Qwen2.5-3B + DAPO 2025.12		30
Llama3.1-8B + Reinforce ++ 2025.12		29.9
Llama3.1-8B + DAPO 2025.12		29.2
Qwen2.5-3B + ARPO 2025.12		28.7
Qwen2.5-7B + DAPO 2025.12		28.6
Qwen2.5-3B + Reinforce ++ 2025.12		27.9
Qwen2.5-7B + Reinforce ++ 2025.12		25.2
Qwen2.5-3B + GRPO 2025.12		24.7
Llama3.1-8B + TIR Prompting 2025.12		15.5
Llama3.1-8B 2025.12		10.4
Qwen2.5-7B + TIR Prompting 2025.12		9.5
Qwen2.5-7B 2025.12		6.6
Qwen2.5-3B + TIR Prompting 2025.12		6.1
Qwen2.5-3B 2025.12		3.6