Share your thoughts, 1 month free Claude Pro on usSee more

Diagram Generation on Code Agent

58.15Pass@1

DiagramAgent

Updated 5mo ago

Evaluation Results

Method	Links
DiagramAgent 2024.11		58.15	51.97	86.83	74.62	53.49	39.71	11.16	45.95	6.38	24.78
DeepSeek-Coder 2024.11		55.56	44.26	83.29	81.85	42.01	30.55	15.49	60.99	6.02	19.8
DeepSeek V2.5 2024.11		54.44	43	82.83	85.67	43.63	28.75	13.32	62.32	5.56	16.98
GPT-4o 2024.11		49.81	44.59	82.83	85.17	43.83	30.08	13.26	63.07	5.56	18.21
Codegeex4-all 2024.11		49.63	42.14	82.94	86.31	41.36	28.69	13.86	61.08	5.48	17.37
Gemini 2024.11		43.23	44.86	82.37	84.44	43.75	30.46	21.69	54.93	3.16	18.7
GLM-4-plus 2024.11		42.96	46.42	83.91	82.4	44.51	32.13	14.7	63.38	4.47	13.89
Qwen2 2024.11		41.48	41.74	82.49	84.86	39.72	27.93	15.57	58.89	4.6	15.48
Yi-Coder 2024.11		37.04	41.38	82.46	83.91	39.2	28	22.4	57.1	3.91	14.11
Yi-1.5 2024.11		35.19	42.56	82.91	85.52	42.03	28.43	20.03	58.04	3.82	12.83
Internlm2_5 2024.11		34.44	39.45	81.79	87	38.44	26.21	24.56	56.81	3.91	13.39
Llama-3.1 2024.11		33.58	37.04	80.45	88.24	36.8	24.79	17.91	58.8	3.78	11.94
Qwen2.5-Coder 2024.11		32.22	41.94	82.58	83.45	38.14	28.09	18.9	60.54	3.72	13.04
WizardCoder 2024.11		28.89	29.93	78.96	91.3	31.38	19.73	27.38	55.96	3.36	11.66
Starcoder2 2024.11		27.41	26.49	78.56	90.67	25.98	17.74	31.63	56.54	3.11	10.53
Baichuan2 2024.11		16.3	33.28	79.94	87.96	31.83	21.51	23.43	61.49	1.81	4.94
Code-Llama 2024.11		8.89	22.92	76.78	95.89	28.77	13.6	30.12	59.8	0.89	2.32