Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language-to-Code Generation on MBPP (dev)
Loading...
75.4
Execution Accuracy
LEVER
60.528
64.389
68.25
72.111
Feb 16, 2023
Execution Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Execution Accuracy
LEVER
Code LLM=codex-davinci...
2023.02
75.4
EP + ML
Code LLM=codex-davinci...
2023.02
62.2
Greedy
Code LLM=codex-davinci...
2023.02
61.1
Feedback
Search any
task
Search any
task
