Share your thoughts, 1 month free Claude Pro on usSee more

Multi-turn tool calling on BFCL MT v4

48Success Rate

Pass@N (oracle)

Updated 1mo ago

Evaluation Results

Method	Links
Pass@N (oracle) 2026.06		48
Greedy Decoding 2026.06		42.5
WildReward-8B 2026.06		42.5
Progress Advantage 2026.06		42.5
ThinkPRM-14B 2026.06		40
Mean-of-N 2026.06		38.5
ThinkPRM-7B 2026.06		37
DeepConf Tail 2026.06		36
Self-Certainty 2026.06		34.5
DeepConf B10 2026.06		34.5
Pass@N (oracle) 2026.06		22
WildReward-8B 2026.06		20
Greedy Decoding 2026.06		19
ThinkPRM-14B 2026.06		19
Progress Advantage 2026.06		19
ThinkPRM-7B 2026.06		18.5
Mean-of-N 2026.06		17.5
DeepConf Tail 2026.06		15.5
DeepConf B10 2026.06		15.5
Self-Certainty 2026.06		15