Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Analytic Concept-Centric Memory for Agentic Embodied Manipulation

About

Long-horizon embodied manipulation requires agents to remember persistent objects, track changing scene states, and reuse prior interaction knowledge. However, existing agent memories are often stored as unstructured histories or embedding-based records, making it difficult to retrieve manipulation-relevant object parts, physical states, action effects, and executable skills. We propose an analytic concept-centric memory framework for agentic embodied manipulation. Our memory organizes experience around structured analytic concepts, where objects are represented by semantic parts, parametric templates, grounded poses, affordances, and manipulation states. It further connects object and scene memories with transition memory for action-induced state changes and skill memory for template-grounded and policy-grounded execution. At runtime, the agent performs structured coarse-to-fine retrieval to identify relevant objects, states, transitions, and skills, supporting state-consistent reasoning and skill reuse. Experiments on memory-dependent manipulation, articulated-object generalization, real-world memory evaluation, and ablations show that our approach improves task completion, retrieval accuracy, object re-identification, and cross-object skill generalization over unstructured and embedding-based memory baselines.

Mingyang Sun, Xiujian Liang, Jiude Wei, Qichen He, Donglin Wang, Cewu Lu, Jianhua Sun• 2026

Related benchmarks

TaskDatasetResultRank
Robotic ManipulationRMBench
Battery Try51
34
Cross-instance transferPartNet-Mobility (unseen instances)
Microwave Success Rate52.2
4
Cross-object transferPartNet-Mobility (unseen categories)
Washing Machine SR30.4
4
Showing 3 of 3 rows

Other info

Follow for update