Sciworld
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Scientific Reasoning | SciWorld | Accuracy95.9 | 164 | |
| Science Simulation | SciWorld | Accuracy94.6 | 41 | |
| Embodied Agentic | SciWorld | Accuracy88.9 | 21 | |
| One-step next-observation prediction | SciWorld (test) | Token F196 | 16 | |
| Next-state prediction | SciWorld (SW) | EM Accuracy98.64 | 16 | |
| Task success | SciWorld | Real68.21 | 14 | |
| Scientific Reasoning | SciWorld | Success Rate (SR)59.48 | 14 | |
| Agent Task | SciWorld | Success Rate @198.4 | 13 | |
| Text-based embodied task | Sciworld | Success Rate77.77 | 13 | |
| Embodied science experiments | SciWorld Seen | Average Accumulated Reward76.3 | 12 | |
| Interactive Decision Making | SciWorld | Score67.3 | 12 | |
| Science simulation | Sciworld | Progress Rate82.6 | 12 | |
| Scientific Simulation | SciWorld | Measure Score55.7 | 10 | |
| Lifelong Agent Interaction | SciWorld | Success Rate (SR)73.5 | 10 | |
| Interactive Agent | SciWorld | Pass@129.45 | 10 | |
| Interactive LLM Agent Task Success | SciWorld Unseen | Success Rate82.4 | 7 | |
| Interactive LLM Agent Task Success | SciWorld (Seen) | Success Rate86.4 | 7 | |
| Autonomous Exploration | SciWorld | Steps7.4 | 7 | |
| Agentic Action Prediction | SCIWorld (out domain) | Success Rate44 | 4 | |
| Agentic Action Prediction | SCIWorld (in domain) | Success Rate61 | 4 | |
| Science Experiment Simulation | SciWorld | Average Reward69.1 | 3 |
Showing 21 of 21 rows