Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Competition-Level Code Generation on CodeContests (val)
Loading...
21
10@1k
AlphaCode
16.736
17.843
18.95
20.057
Feb 8, 2022
10@1k
10@10k
10@100k
10@1M
Updated 1mo ago
Evaluation Results
Method
Method
Links
10@1k
10@10k
10@100k
10@1M
AlphaCode
Model size=41B, Cluste...
2022.02
21
26.2
31.8
34.2
AlphaCode
Model size=9B, Cluster...
2022.02
16.9
22.6
27.1
30.1
AlphaCode
Model size=41B, Cluste...
2022.02
16.9
23.9
28.2
31.8
Feedback
Search any
task
Search any
task
