Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Program synthesis on SPoC (TestP)
Loading...
0.385
Success Rate
DrRepair w/ pseudocode
0.16972
0.22561
0.2815
0.33739
May 20, 2020
Success Rate
Updated 4d ago
Evaluation Results
Method
Method
Links
Success Rate
DrRepair w/ pseudocode
Search budget (B)=100
2020.05
0.385
DrRepair
Search budget (B)=100
2020.05
0.375
Prior best
Search budget (B)=100
2020.05
0.342
Best first search
Search budget (B)=100
2020.05
0.325
DrRepair w/ pseudocode
Search budget (B)=10
2020.05
0.314
DrRepair
Search budget (B)=10
2020.05
0.302
Prior best
Search budget (B)=10
2020.05
0.284
Best first search
Search budget (B)=10
2020.05
0.265
Top 1 (no search)
Search budget (B)=10
2020.05
0.178
Top 1 (no search)
Search budget (B)=100
2020.05
0.178
Feedback
Search any
task
Search any
task