Share your thoughts, 1 month free Claude Pro on usSee more

Tool Calling on DIABENCH Dynamic Evaluation 1.0

89ACC

Llama-3.3-Nemotron-DiaFORGE-49B

Updated 5d ago

Evaluation Results

Method	Links
Llama-3.3-Nemotron-DiaFORGE-49B 2025.07		89	6	3
Gemma-3-DiaFORGE-27B 2025.07		89	3	3
Gemma-3-DiaFORGE-12B 2025.07		86	7	7
Gemma-3-DiaFORGE-4B 2025.07		81	9	5
Llama-3.2-DiaFORGE-3B 2025.07		80	8	6
Llama-3.3-DiaFORGE-70B 2025.07		79	3	15
Llama-3.3-Nemotron-Super-49B 2025.07		72	8	8
GPT-4o-20241120 2025.07		62	2	36
GPT-4o-20241120-fc 2025.07		56	59	5
Llama-xLAM-2-70B-fc-r 2025.07		51	18	5
Claude-3.5-Sonnet-20241022-fc 2025.07		40	34	3
Claude-3.5-Sonnet-20241022 2025.07		39	3	55
Gemma-3-12B 2025.07		37	4	57
Llama-3.3-70B-fc 2025.07		30	22	1
Gemma-3-4B 2025.07		24	14	58
Gemma-3-27B 2025.07		21	0	79
Llama-3.3-70B 2025.07		11	2	88