Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language-to-code generation on GSM8k (dev)
Loading...
84.1
Execution Accuracy
LEVER
18.164
35.282
52.4
69.518
Feb 16, 2023
Execution Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Execution Accuracy
LEVER
Base model=codex-davin...
2023.02
84.1
EP + ML
Base model=codex-davin...
2023.02
72.1
Greedy
Base model=codex-davin...
2023.02
68.1
Neo-2.7B + SS
Finetuning status=With...
2023.02
20.7
Feedback
Search any
task
Search any
task
