Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Tool-calling on BFCL v3 (test)
Loading...
18
Base Accuracy
Memp
1.36
5.68
10
14.32
Jun 9, 2026
Base Accuracy
Live Overall Accuracy
Multi Turn Overall Accuracy
Non-Live Overall Accuracy
Average Accuracy
Correct Format
Miss Rate F
Miss Rate P
Long Context Success Rate
Updated 1mo ago
Evaluation Results
Method
Method
Links
Base Accuracy
Live Overall Accuracy
Multi Turn Overall Accuracy
Non-Live Overall Accuracy
Average Accuracy
Correct Format
Miss Rate F
Miss Rate P
Long Context Success Rate
Memp
Model=Llama3.2-3B-Inst...
2026.06
18
-
-
-
10.75
-
8
9
8
KATE w/o PS
Model=Llama3.2-3B-Inst...
2026.06
18
-
-
-
12.75
-
14
11
8
KATE r PS-Con.
Model=Llama3.2-3B-Inst...
2026.06
14
-
-
-
11
-
15
9
6
KATE
Model=Llama3.2-3B-Inst...
2026.06
12
-
-
-
11.25
-
15
11
7
KATE w/o Exp
Model=Llama3.2-3B-Inst...
2026.06
7
-
-
-
4.25
-
3
3
4
FC
Model=Llama3.2-3B-Inst...
2026.06
2
-
-
-
2
-
3
1
2
Feedback
Search any
task
Search any
task