Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

XEmbodied: A Foundation Model with Enhanced Geometric and Physical Cues for Large-Scale Embodied Environments

About

Vision-Language-Action (VLA) models drive next-generation autonomous systems, but training them requires scalable, high-quality annotations from complex environments. Current cloud pipelines rely on generic vision-language models (VLMs) that lack geometric reasoning and domain semantics due to their 2D image-text pretraining. To address this mismatch, we propose XEmbodied, a cloud-side foundation model that endows VLMs with intrinsic 3D geometric awareness and interaction with physical cues (e.g., occupancy grids, 3D boxes). Instead of treating geometry as auxiliary input, XEmbodied integrates geometric representations via a structured 3D Adapter and distills physical signals into context tokens using an Efficient Image-Embodied Adapter. Through progressive domain curriculum and reinforcement learning post-training, XEmbodied preserves general capabilities while demonstrating robust performance across 18 public benchmarks. It significantly improves spatial reasoning, traffic semantics, embodied affordance, and out-of-distribution generalization for large-scale scenario mining and embodied VQA.

Kangan Qian, ChuChu Xie, Yang Zhong, Jingrui Pang, Siwen Jiao, Sicong Jiang, Zilin Huang, Yunlong Wang, Kun Jiang, Mengmeng Yang, Hao Ye, Guanghao Zhang, Hangjun Ye, Guang Chen, Long Chen, Diange Yang• 2026

Related benchmarks

TaskDatasetResultRank
End-to-end PlanningnuScenes (open-loop)
L2 Error (1s)0.14
24
Visual AffordanceVABench Point
Score3.5
20
Robot Embodied ReasoningRobot-R1 Bench
Score3.8
15
Semantic ReasoningMapLM v2
Score78.55
15
Semantic ReasoningOmniDrive
Score25.43
15
Spatial & 3D UnderstandingSURDS
SURDS Spatial & 3D Score83.83
15
Spatial & 3D UnderstandingVLADBench
Score68.61
15
Semantic ReasoningLingoQA
Score65.7
15
Spatial & 3D UnderstandingEgo3DBench (OOD)
Accuracy (ACC)55.28
15
Semantic ReasoningDriveBench
Score53.18
14
Showing 10 of 17 rows

Other info

Follow for update