Share your thoughts, 1 month free Claude Pro on usSee more

Function Calling on BFCL V3 (test)

63.34Overall Accuracy

CoALM 405B

Updated 1mo ago

Evaluation Results

Method	Links
CoALM 405B 2025.02		63.34	90.46	84.75	74.59	28.25	100	72.26
CoALM 70B 2025.02		60.49	82.94	81.36	72.19	26.25	72.22	85.36
GPT-4o 2025.02		59.83	70.08	60.79	76.41	34.62	51.22	87.34
GPT-4o-mini 2025.02		59.4	86.52	85.05	73.26	19	78.05	76.97
Llama-3.1-405B-Instruct 2025.02		56.38	89.71	84.7	70.77	11.75	88.89	70.86
CoALM 8B 2025.02		54.11	85.17	78.61	72.59	7	77.78	83
ToolAce 2025.02		52.55	82.19	86.98	71.08	0.88	70.73	87.29
Hammer2.0-7b 2025.02		52.13	86.94	83.66	71.17	0.38	95.12	73.2
Llama-3.3-70B-Instruct 2025.02		51.36	84.85	90.05	62.51	7.25	95.12	48.33
Llama-3.1-8B-Instruct 2025.02		49.84	84.25	79.75	60.33	10.25	75.61	47.92
Mistral-7B-Instruct 2025.02		38.35	56.33	63.77	57.31	0.25	77.78	41.84