Our new X account is live! Follow @wizwand_team for updates

Function Calling on BFCL V3 (test)

63.34Overall Accuracy

CoALM 405B

Updated 3d ago

Evaluation Results

Method	Links
CoALM 405B 2025.02		63.34	90.46	84.75	74.59	28.25	100	72.26
CoALM 70B 2025.02		60.49	82.94	81.36	72.19	26.25	72.22	85.36
GPT-4o 2025.02		59.83	70.08	60.79	76.41	34.62	51.22	87.34
GPT-4o-mini 2025.02		59.4	86.52	85.05	73.26	19	78.05	76.97
Llama-3.1-405B-Instruct 2025.02		56.38	89.71	84.7	70.77	11.75	88.89	70.86
CoALM 8B 2025.02		54.11	85.17	78.61	72.59	7	77.78	83
ToolAce 2025.02		52.55	82.19	86.98	71.08	0.88	70.73	87.29
Hammer2.0-7b 2025.02		52.13	86.94	83.66	71.17	0.38	95.12	73.2
Llama-3.3-70B-Instruct 2025.02		51.36	84.85	90.05	62.51	7.25	95.12	48.33
Llama-3.1-8B-Instruct 2025.02		49.84	84.25	79.75	60.33	10.25	75.61	47.92
Mistral-7B-Instruct 2025.02		38.35	56.33	63.77	57.31	0.25	77.78	41.84