Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Embodied Task Execution on MEMENTO Acquisition Stage
Loading...
16
Planning Cycles
Claude-3.5-Sonnet
15.772
17.311
18.85
20.389
May 22, 2025
Planning Cycles
Simulation Steps
Completion Percentage
Success Rate
Updated 5mo ago
Evaluation Results
Method
Method
Links
Planning Cycles
Simulation Steps
Completion Percentage
Success Rate
Claude-3.5-Sonnet
Stage=Acquisition, Tas...
2025.05
16
2,104.1
96.2
94
GPT-4o
Stage=Acquisition, Tas...
2025.05
16.5
2,156.1
96.3
95
Qwen-2.5-72b
Stage=Acquisition, Tas...
2025.05
17.5
2,281.9
93.5
91
Llama-3.1-70b
Stage=Acquisition, Tas...
2025.05
17.7
2,162.1
92.9
90
Llama-3.1-8b
Stage=Acquisition, Tas...
2025.05
19.3
2,377
78.1
68.5
Qwen-2.5-7b
Stage=Acquisition, Tas...
2025.05
21.7
2,476.8
64.1
53.2
Feedback
Search any
task
Search any
task