Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Program synthesis on SPoC (TestW)
Loading...
57
Success Rate
DrRepair w/ pseudocode
29.648
36.749
43.85
50.951
May 20, 2020
Success Rate
Updated 4d ago
Evaluation Results
Method
Method
Links
Success Rate
DrRepair w/ pseudocode
Search budget (B)=100
2020.05
57
DrRepair
Search budget (B)=100
2020.05
55.9
Prior best
Search budget (B)=100
2020.05
53.7
Best first search
Search budget (B)=100
2020.05
51
DrRepair w/ pseudocode
Search budget (B)=10
2020.05
48
DrRepair
Search budget (B)=10
2020.05
46.6
Prior best
Search budget (B)=10
2020.05
44.4
Best first search
Search budget (B)=10
2020.05
42.5
Top 1 (no search)
Search budget (B)=10
2020.05
30.7
Top 1 (no search)
Search budget (B)=100
2020.05
30.7
Feedback
Search any
task
Search any
task