Function Calling

Benchmarks

Dataset Name	SOTA Method	Metric
BFCL V3	D-CORE-14B	Overall Accuracy79.3	88	4d ago
BFCL Multi-Turn v3		Overall Accuracy68.38	41	4d ago
BFCL Individual Tools per Problem		Execution Accuracy95	30	4d ago
BFCL (Berkeley Function Calling Leaderboard)	GenEnv	Base Score41.8	28	4d ago
Berkeley Function Call Leaderboard (BFCL) Live (Out-of-Domain)	Qwen3-4B	AST Simple0.876	26	4d ago
Berkeley Function Call Leaderboard (BFCL) Non-Live Out-of-Domain		AST Simple81.4	26	4d ago
Berkeley Function Call Leaderboard (BFCL) online inference setting	Qwen3-8B	Input Tokens621.13	19	4d ago
TB-MM	DTDR-L	FSA64.1	18	4d ago
TB-HF	DTDR-L	FSA60.5	18	4d ago
TB-DL	DTDR-L	FSA89	18	4d ago
TinyAgent	DTDR-L	FSA0.807	18	4d ago
BFCL		Energy (Wh)4.2	18	4d ago
BFCL Multi-Turn v4 (test)	FISSION-GRPO	Overall Acc46.75	17	4d ago
ToolBench Average	Claude-3.5-Sonnet + TAFC	Pass Rate60.3	14	4d ago
ToolBench I3-Inst	Claude-3.5-Sonnet + TAFC	Pass Rate52.4	14	4d ago
ToolBench I2-Inst	Claude-3.5-Sonnet + TAFC	Pass Rate71.4	14	4d ago
ToolBench I1-Inst	Claude-3.5-Sonnet + TAFC	Pass Rate57.1	14	4d ago
BFCL (Held-In)	SHAD+RFT	Accuracy89.4	14	4d ago
ACEBench Normal		Accuracy75.6	13	4d ago
BFCL v4		Score68.8	13	4d ago
BFCL Executable (test)		Success Rate (Simple, Python)100	12	4d ago
API-Bank Level-2	CoALM 70B	ROUGE-L83.2	12	3d ago
API-Bank Level-1	CoALM 405B	ROUGE-L93.4	12	3d ago
BFCL V3 (test)	CoALM 405B	Overall Accuracy63.34	11	3d ago
Berkeley Function Calling Leaderboard (BFCL) Live and Non-live	Qwen2.5-72B-it	Non-live AST Score90.8	11	4d ago

Showing 25 of 42 rows