Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Generation on CodeContest
Loading...
28.5
Pass@1
MapCoder
4.58
10.79
17
23.21
May 18, 2024
Pass@1
Updated 4d ago
Evaluation Results
Method
Method
Links
Pass@1
MapCoder
LLM=GPT-4
2024.05
28.5
MapCoder
LLM=ChatGPT
2024.05
12.7
Direct
LLM=GPT-4
2024.05
12.1
Self-Planning
LLM=GPT-4
2024.05
10.9
Analogical
LLM=GPT-4
2024.05
10.9
Analogical
LLM=ChatGPT
2024.05
7.3
CoT
LLM=ChatGPT
2024.05
6.1
Self-Planning
LLM=ChatGPT
2024.05
6.1
Direct
LLM=ChatGPT
2024.05
5.5
CoT
LLM=GPT-4
2024.05
5.5
Feedback
Search any
task
Search any
task