Share your thoughts, 1 month free Claude Pro on usSee more

Multi-Turn Function Calling on BFCL Multi-Turn Base v3

69Greedy Success Rate

Claude-Sonnet-4.5

Updated 3mo ago

Evaluation Results

Method	Links
Claude-Sonnet-4.5 2026.04		69
Qwen3-30B-A3B 2026.04		67
Qwen3-4B-Instruct 2026.04		63
Qwen2.5-7B-Instruct 2026.04		61.5
GPT-4 2026.04		54
CuES 2025.12		44.2
o3 2025.12		44
DeepSeek-V3 2025.12		43.5
GPT-4o-mini 2025.12		43.5
Qwen3-30B-A3B 2026.04		43.5
Amazon-Nova-Pro-v1:0 2025.12		42.5
Gemini-2.5-Flash 2026.04		41.5
DeepSeek-V3.2 2026.04		41.5
Gemini-2.5-Flash 2025.12		36
Gemini-2.5-Pro 2025.12		35
GPT-5 2025.12		33.5
GPT-5-nano 2025.12		33.5
GPT-5-mini 2025.12		31.5
Amazon-Nova-Lite-v1:0 2025.12		29
Qwen3-4B-Instruct 2026.04		26.5
LLaMA-3.3-70B 2026.04		26
Gemma-3-27B 2026.04		16.5
GPT-OSS-20B 2026.04		14
Qwen2.5-7B-Instruct 2026.04		13.5