Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Efficiency Test Generation on CodeContests Java
Loading...
63.08
Acceptance Success Rate (Fast)
STAB
26.1808
35.7604
45.34
54.9196
May 27, 2026
Acceptance Success Rate (Fast)
Acceptance Success Rate (Slow)
Acceptance Success Rate (Random)
Updated 6d ago
Evaluation Results
Method
Method
Links
Acceptance Success Rate (Fast)
Acceptance Success Rate (Slow)
Acceptance Success Rate (Random)
STAB
Model=Gemma-4
2026.05
63.08
82.17
82.98
STAB
Model=Gemini-3.1
2026.05
59.82
77.65
79.91
STAB
Model=Qwen-3.5
2026.05
59.46
75.11
77.41
STAB
Model=GPT-5.4
2026.05
58.01
75.66
77.31
Base
Model=GPT-5.4
2026.05
57.47
74.3
73.82
Base
Model=Gemma-4
2026.05
41.54
57.38
41.33
Base
Model=Gemini-3.1
2026.05
35.48
58.91
59.79
Base
Model=Qwen-3.5
2026.05
27.6
56.65
59.43
Feedback
Search any
task
Search any
task