Our new X account is live! Follow @wizwand_team for updates

Issue-level Localization on SecGenEval-PS CodeAnalysis

59.1Success Rate @ Issue

o3-mini

Updated 4d ago

Evaluation Results

Method	Links
o3-mini 2026.01		59.1	34.7
o3-mini 2026.01		56.7	37.9
GPT-4o 2026.01		25.1	6.7
GPT-4o 2026.01		23.3	6
GPT-4o 2026.01		13.6	4
o3-mini 2026.01		6.8	2.4
DeepSeek-R1-Distill-Qwen-7B 2026.01		1.3	0.9
Qwen2.5-Coder-7B 2026.01		0	0
Qwen2.5-Coder-7B 2026.01		0	0
Qwen2.5-Coder-7B 2026.01		0	0
Qwen2.5-7B 2026.01		0	0