Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation

About

As an essential modality for dexterous and contact-rich tasks, tactile sensing provides precise force feedback that cannot be reliably inferred from vision. However, limited by hardware and data collection systems, existing datasets with tactility remain small in scale and narrow in contact coverage. Meanwhile, Vision-Language-Action (VLA) models with tactile modality are constrained on dynamics-agnostic post-training, which limits the performance ceiling on downstream tasks. In this paper, we present H-Tac, a large-scale tactile-action dataset with 160-hour egocentric human videos containing more than 300 tasks and 135k episodes. Building upon this, we propose Transferable Tactile Pre-Training (TTP), a system of tactile-based pre-training on human data for fine-grained robotic tasks. To bridge the gap between humans and robots, we use unified tactile and action spaces throughout the pre-training and post-training phases, preserving prior knowledge during human-to-robot transfer. By leveraging a tactile expert for future tactile prediction, our framework explicitly models the contact dynamics and precise physical interactions. Extensive experiments in simulation and on real robots demonstrate that our model achieves superior performance, exhibiting robust generalization and fine-grained manipulation capabilities. TTP paves the way for scalable tactile pre-training via human-to-robot transfer.

Chi Zhang, Penglin Cai, Ziheng Xi, Haoqi Yuan, Hao Luo, Wanpeng Zhang, Sipeng Zheng, Chaoyi Xu, Zongqing Lu• 2026

Related benchmarks

TaskDatasetResultRank
Robotic ManipulationLIBERO-Plus
Language Understanding Score84.3
414
Robotic ManipulationLIBERO
Long-horizon Success Rate97
165
Robotic ManipulationRoboCasa
Average Success Rate55.1
68
Contact-rich & Fragile manipulationReal-robot Contact-rich & Fragile tasks (10 ID + 5 OOD trials)
Average Task Progress Rate79.2
5
Fine-grained manipulationReal-robot Fine-grained tasks 10 ID + 5 OOD trials
Average Task Progress Rate96.7
5
Vision Defect manipulationReal-robot Vision Defect tasks 10 ID + 5 OOD trials
Average Task Progress Rate37.8
5
Showing 6 of 6 rows

Other info

Follow for update