Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WorldString: Actionable World Representation

About

Inspired by the emergent behaviors in large language models that generalized human intelligence, the research community is pursuing similar emergent capabilities within world models, with a emphasis on modeling the physical world. Within the scope of physical world model, objects are the fundamental primitives that constitute physical reality. From humans to computers, nearly everything we interact with is an object. These objects are rarely static; they are actionable entities with varying states determined by their intrinsic properties. While current methods approach object action states either via video generation or dynamic scene reconstruction, none explicitly model this basic element in a unified, principled way to build an actionable object representation. We propose WorldString, a neural architecture capable of modeling the state manifold of real-world objects by learning directly from point clouds or RGB-D video streams. Serving as a versatile digital twin, it acts as a foundational building block for physical world models; thus, we name it WorldString. Sweetly, its fully differentiable structure seamlessly enables future integration with policy learning and neural dynamics.

Kunqi Xu, Jitao Li, Jianglong Ye, Tianshu Tang, Isabella Liu, Sifei Liu, Xueyan Zou• 2026

Related benchmarks

TaskDatasetResultRank
Articulated Object ReconstructionRobot 1 Hand Xhand
IoU90.28
4
Articulated Object ReconstructionRobot 2 Arm Airbot Play
mIoU77
4
Articulated Object ReconstructionFurniture 21 IKEA Cabinet
IoU90.17
4
Articulated Object ReconstructionFurniture IKEA Cabinet 09
IoU88.98
4
Biological SkinningSMPL Male Skeleton
IoU83.47
4
Biological SkinningSMPL Female Skeleton
IoU87.83
4
Biological SkinningSMAL Horse Skeleton
mIoU90.54
4
Biological SkinningSMAL Hippo Skeleton
mIoU92.4
4
Deformable Object ReconstructionReal World Soft Bodies Doll
IoU82.8
3
Deformable Object ReconstructionReal World Soft Bodies Cloth
mIoU68.68
3
Showing 10 of 12 rows

Other info

Follow for update