Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ScienceWorld

Benchmarks

Task NameDataset NameSOTA ResultTrend
Interactive Decision MakingScienceWorld
Success Rate69.97
78
Interactive Decision MakingScienceWorld Seen
Success Rate88.8
72
Interactive Environment Task CompletionScienceWorld (Unseen)
Average Reward90.1
34
Science Experimentation ReasoningScienceWorld (unseen)
Success Rate88.6
32
Science Experimentation ReasoningScienceWorld (seen)
Success Rate89.7
32
Interactive Decision MakingScienceWorld Unseen
Success Rate85.15
32
Interactive ReasoningScienceWorld (Seen)
Success Rate63.91
31
World modellingScienceWorld
EM (Exact Match)100
30
World ModelingScienceWorld
Exact Match (EM)47.7
30
Mean RewardScienceWorld
Mean Reward0.319
30
Science Simulation Task CompletionScienceWorld Unseen
Success Rate66.3
28
Science Simulation Task CompletionScienceWorld Seen
Success Rate69.8
28
Multi-turn Agentic TaskScienceWorld
Success Rate62
28
Interactive environment reasoning and problem-solvingScienceWorld
Average Score70.2
27
Interactive Science ReasoningScienceWorld (test)
Score84.6
27
scientific reasoningScienceWorld
Success Rate75.9
26
Science SimulationScienceWorld
Success Rate15.44
24
Science Experiment ExecutionScienceWorld (test)
Success Rate51.51
24
Interactive Decision-makingScienceWorld Unseen (test)
Success Rate58.94
24
Interactive Environment Task CompletionScienceWorld (Seen)
Average Reward89.5
22
Agentic ReasoningScienceWorld
Original Score82.2
20
Interactive Decision MakingScienceWorld Seen (val)
Average Reward0.7349
20
World ModelingScienceWorld
Matter Score52.8
20
Embodied Agent TaskScienceWorld Unseen
Success Rate70.8
18
Embodied Agent TaskScienceWorld Seen
Success Rate70.9
18
Showing 25 of 127 rows