Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Control Code Generation on Robotic Headphone Manipulation Task 4 1.0 (test)
Loading...
100
R-L Score
Ours
57.36
68.43
79.5
90.57
Feb 13, 2025
R-L Score
mIoU
Execution Success Rate (Exe)
Task Success Rate (TSR)
Updated 1mo ago
Evaluation Results
Method
Method
Links
R-L Score
mIoU
Execution Success Rate (Exe)
Task Success Rate (TSR)
Ours
2025.02
100
96.2
99
96
Text-guided VLM
Chain-of-Thought (COT)...
2025.02
88
-
93
72
Ours (-2D Prompt)
2D Prompting=False
2025.02
88
0
25
0
End2End VLM
2025.02
68
0
25
0
Text-guided VLM
2025.02
68
-
86.5
46
3D Multimodal LM
2025.02
68
78.1
93
74
Ours (-SLM)
Supervised Learning Mo...
2025.02
68
84.7
95.5
82
Text-guided LLM
2025.02
59
-
78.5
14
Feedback
Search any
task
Search any
task