Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language-to-code generation on GSM8k (dev)
Loading...
84.1
Execution Accuracy
LEVER
18.164
35.282
52.4
69.518
Feb 16, 2023
Execution Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Execution Accuracy
LEVER
Base model=codex-davin...
2023.02
84.1
EP + ML
Base model=codex-davin...
2023.02
72.1
Greedy
Base model=codex-davin...
2023.02
68.1
Neo-2.7B + SS
Finetuning status=With...
2023.02
20.7
Feedback
Search any
task
Search any
task