Robotic Manipulation on CALVIN ABCD->D (Success Rate conditioned on Instruction Length)
99.7Success Rate (1 Inst)
SDP
Updated 3d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.01 | 99.7 | 96.7 | 93.8 | 90.8 | 86.5 | 4.67 | |
2026.01 | 99.3 | 96.1 | 90.9 | 85.3 | 76.9 | 4.49 | |
2026.01 | 98.6 | 95.8 | 91.6 | 86.2 | 80.1 | 4.52 | |
2026.02 | 98 | 93.6 | 85.4 | 77.8 | 70.4 | 4.25 | |
2026.02 | 97.6 | 93.2 | 88.8 | 85.7 | 78.1 | 4.45 | |
2026.01 | 96.4 | 89.6 | 82.4 | 74 | 66 | 4.09 | |
2026.02 | 96.3 | 91.6 | 86.1 | 80.3 | 74 | 4.28 | |
2026.01 | 95.8 | 88.1 | 79.3 | 70.8 | 62.4 | 3.92 | |
2026.02 | 95.7 | 91.2 | 86.3 | 81 | 75 | 4.29 | |
2026.02 | 95.6 | 87.6 | 76.9 | 69.3 | 64.1 | 3.95 | |
2026.01 | 95.5 | 85.8 | 75.4 | 66.9 | 56.5 | 3.8 | |
2026.02 | 95.5 | 85.8 | 75.4 | 66.9 | 56.5 | 3.8 | |
2026.01 | 95.4 | 89.1 | 83.8 | 78.5 | 73.4 | 4.19 | |
2026.01 | 94.9 | 89.6 | 84.4 | 78.9 | 73.1 | 4.21 | |
2026.01 | 94.4 | 82.7 | 72.1 | 62.4 | 55.4 | 3.66 | |
2026.02 | 94.4 | 82.7 | 72.1 | 62.4 | 54.4 | 3.66 | |
2026.02 | 94.4 | 88.4 | 85.3 | 80.1 | 76.1 | 4.26 | |
2026.02 | 93.8 | 85 | 76.7 | 68.1 | 59.9 | 3.92 | |
2026.02 | 92.8 | 86.5 | 81.5 | 76.9 | 69.9 | 4.08 | |
2026.01 | 91.3 | 77.8 | 62 | 52.1 | 43.5 | 3.27 | |
2026.02 | 91.3 | 77.8 | 62 | 52.1 | 43.5 | 3.27 | |
2026.01 | 86.3 | 72.7 | 60.1 | 51.2 | 41.7 | 3.16 | |
2026.01 | 85.4 | 71.2 | 59.6 | 49.7 | 40.1 | 3.06 | |
2026.01 | 82.4 | 61.9 | 46.6 | 33.1 | 23.5 | 2.47 | |
2026.01 | 63.5 | 35.3 | 19.4 | 10.7 | 6.4 | 1.35 | |
2026.01 | 53.3 | 22.2 | 9.4 | 3.8 | 1.3 | 0.9 |