Our new X account is live! Follow @wizwand_team for updates

Code Evaluation on SWE Verified Agentless

57.6pass@1

DeepSeek-R1 0528 671B

Updated 4d ago

Evaluation Results

Method	Links
DeepSeek-R1 0528 671B 2025.12		57.6
Nemotron-Cascade 14B-Thinking (Test-Time Scaling) 2025.12		53.8
Gemini-2.5 Flash-Thinking 2025.12		48.9
Nemotron Cascade-8B (Test-Time Scaling) 2025.12		43.6
Nemotron-Cascade 14B-Thinking 2025.12		43.1
Nemotron Cascade-8B 2025.12		37.2
Qwen3 14B 2025.12		27.4
Qwen3 8B 2025.12		20.5