Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TactAlign: Human-to-Robot Policy Transfer via Tactile Alignment

About

Human demonstrations collected by wearable devices (e.g., tactile gloves) provide fast and dexterous supervision for policy learning, and are guided by rich, natural tactile feedback. However, a key challenge is how to transfer human-collected tactile signals to robots despite the differences in sensing modalities and embodiment. Existing human-to-robot (H2R) approaches that incorporate touch often assume identical tactile sensors, require paired data, and involve little to no embodiment gap between human demonstrator and the robots, limiting scalability and generality. We propose TactAlign, a cross-embodiment tactile alignment method that transfers human-collected tactile signals to a robot with different embodiment. TactAlign transforms human and robot tactile observations into a shared latent representation using a rectified flow, without paired datasets, manual labels, or privileged information. Our method enables low-cost latent transport guided by hand-object interaction-derived pseudo-pairs. We demonstrate that TactAlign improves H2R policy transfer across multiple contact-rich tasks (pivoting, insertion, lid closing), generalizes to unseen objects and tasks with human data (less than 5 minutes), and enables zero-shot H2R transfer on a highly dexterous tasks (light bulb screwing).

Youngsun Wi, Jessica Yin, Elvis Xiang, Akash Sharma, Jitendra Malik, Mustafa Mukadam, Nima Fazeli, Tess Hellebrekers• 2026

Related benchmarks

TaskDatasetResultRank
InsertionH2R Seen-by-both objects
Success Rate100
4
InsertionH2R Human-only objects
Success Rate6.50e+3
4
InsertionH2R Unseen-by-both objects
Success Rate67
4
Lid ClosingH2R Human-only objects
Success Rate65
4
Lid ClosingH2R Unseen-by-both objects
Success Rate70
4
PivotingH2R Human-only objects
Success Rate83
4
PivotingH2R Unseen-by-both objects
Success Rate60
4
Lid ClosingH2R Seen-by-both objects
Success Rate100
4
PivotingH2R Seen-by-both objects
Success Rate1
4
Light Bulb ScrewingLight Bulb Screwing
Success Rate1.00e+4
3
Showing 10 of 10 rows

Other info

Follow for update