Robotic Manipulation Task Code Generation on Tabletop Manipulation simulator
100Execution Success Rate
Lang2Code
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2023.05 | 100 | 33 | 0.73 | |
2023.05 | 100 | 30 | 0.08 | |
2023.05 | 100 | 20 | 0.59 | |
2023.05 | 100 | 3 | 0.23 | |
2023.05 | 100 | 20 | 0.87 | |
2023.05 | 100 | 37 | 0.89 | |
2023.05 | 100 | 13 | 0.07 | |
2023.05 | 100 | 13 | 0 | |
2023.05 | 100 | 0 | 0 | |
2023.05 | 100 | 19 | 0.39 | |
2023.05 | 100 | 100 | 0.83 | |
2023.05 | 100 | 95 | 0.84 | |
2023.05 | 100 | 70 | 0.5 | |
2023.05 | 100 | 83 | 0.49 | |
2023.05 | 100 | 67 | 0.52 | |
2023.05 | 100 | 90 | 0.68 | |
2023.05 | 100 | 100 | 0.98 | |
2023.05 | 100 | 100 | 1 | |
2023.05 | 100 | 100 | 0.84 | |
2023.05 | 100 | 70 | 0.5 | |
2023.05 | 100 | 100 | 1 | |
2023.05 | 100 | 87 | 0.71 | |
2023.05 | 100 | 90 | 0.58 | |
2023.05 | 100 | 90 | 0.65 | |
2023.05 | 99 | 88 | 0.77 | |
2023.05 | 93 | 81 | 0.6 | |
2023.05 | 90 | 80 | 0.82 | |
2023.05 | 90 | 77 | 0.19 | |
2023.05 | 90 | 40 | 0.4 | |
2023.05 | 60 | 70 | 0.56 |