Share your thoughts, 1 month free Claude Pro on usSee more

Tool-use Reasoning on ShopTrajQA 32k context

62.6Accuracy

gpt-oss-120B

Updated 1mo ago

Evaluation Results

Method	Links
gpt-oss-120B 2026.06		62.6
Qwen3-4B-SFT-RLVR 2026.06		62.5
Qwen3-1.7B-SFT-RLVR 2026.06		59.2
Qwen3-4B 2026.06		48
Qwen3-Coder-30B 2026.06		38.4
Qwen3-4B-SFT 2026.06		36.4
gpt-oss-120B 2026.06		28.7
Qwen3-1.7B-SFT 2026.06		28.1
Qwen3-Coder-30B 2026.06		25
Qwen3-1.7B 2026.06		23
gpt-oss-20B 2026.06		22.3
Qwen3-1.7B 2026.06		17.3
gpt-oss-20B 2026.06		17.1
Qwen3-4B 2026.06		13.8