Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Repository-level patch generation on SWE-Bench Lite (held-out 25% eval)
Loading...
102.7
Utility Difference (Δπ)
Rfx
7.956
32.553
57.15
81.747
Jun 23, 2026
Utility Difference (Δπ)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Utility Difference (Δπ)
Rfx
Generator=gpt-5-mini
2026.06
102.7
bayesian_greedy
Generator=gpt-5-mini
2026.06
62
bayesian_DP
Generator=gpt-5-mini
2026.06
62
SR
Generator=gpt-5-mini
2026.06
24.4
tCsyn
Generator=gpt-5-mini
2026.06
21.7
BoN
Generator=gpt-5-mini
2026.06
17.3
tCllm
Generator=gpt-5-mini
2026.06
13.7
fixed_pipeline
Generator=gpt-5-mini
2026.06
11.6
Feedback
Search any
task
Search any
task