JoyAI-RA 0.1: A Foundation Model for Robotic Autonomy
About
Robotic autonomy in open-world environments is fundamentally limited by insufficient data diversity and poor cross-embodiment generalization. Existing robotic datasets are often limited in scale and task coverage, while relatively large differences across robot embodiments impede effective behavior knowledge transfer. To address these challenges, we propose JoyAI-RA, a vision-language-action (VLA) embodied foundation model tailored for generalizable robotic manipulation. JoyAI-RA presents a multi-source multi-level pretraining framework that integrates web data, large-scale egocentric human manipulation videos, simulation-generated trajectories, and real-robot data. Through training on heterogeneous multi-source data with explicit action-space unification, JoyAI-RA effectively bridges embodiment gaps, particularly between human manipulation and robotic control, thereby enhancing cross-embodiment behavior learning. JoyAI-RA outperforms state-of-the-art methods in both simulation and real-world benchmarks, especially on diverse tasks with generalization demands.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robot Manipulation | RoboTwin Randomized 2.0 | Overall Success Rate89.3 | 100 | |
| Robotic Manipulation | RoboTwin 50-task (Seen Tasks) | Average Success Rate89.9 | 27 | |
| Robotic Manipulation | RoboCasa GR1 Tabletop | Average Success Rate63.2 | 24 | |
| Robotics Task Execution | RoboTwin 2.0 (Clean) | Success Rate90.5 | 20 | |
| Robot Manipulation | RoboTwin Easy 2.0 | Average Success Rate90.48 | 14 | |
| Robot Manipulation | RoboTwin Hard 2.0 | Average Success Rate89.28 | 13 | |
| Bimanual Robot Manipulation | RoboTwin Easy 2.0 | Average Success Rate90.48 | 12 | |
| Bimanual Robotic Manipulation | RoboTwin Hard 2.0 | Success Rate (Overall)89.28 | 12 | |
| Robotic Manipulation | RoboCasa GR1 Tabletop 26 | Success Rate63.2 | 7 |