Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Vibe Coding on NL2Repo
Loading...
49.3
Score
GPT-5.2 High
18.308
26.354
34.4
42.446
Jun 30, 2026
Score
Pass@1
Updated 24d ago
Evaluation Results
Method
Method
Links
Score
Pass@1
GPT-5.2 High
2026.06
49.3
8
Claude-Opus-4.5
2026.06
43.2
3
Claude-Sonnet-4.5
2026.06
39.9
3
Gemini-3-pro High
2026.06
34.2
4
Seed2.0 Pro
2026.06
27.9
3
Gemini-3-Flash High
2026.06
27.6
2
Seed2.0 Lite
2026.06
24.6
1
GPT-5-mini High
2026.06
19.5
2
Feedback
Search any
task
Search any
task