Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Proprioceptive Image: An Image Representation of Proprioceptive Data from Quadruped Robots for Contact Estimation Learning

About

This paper presents a novel approach for representing proprioceptive time-series data from quadruped robots as structured two-dimensional images, enabling the use of convolutional neural networks for learning locomotion-related tasks. The proposed method encodes temporal dynamics from multiple proprioceptive signals, such as joint positions, IMU readings, and foot velocities, while preserving the robot's morphological structure in the spatial arrangement of the image. This transformation captures inter-signal correlations and gait-dependent patterns, providing a richer feature space than direct time-series processing. We apply this concept in the problem of contact estimation, a key capability for stable and adaptive locomotion on diverse terrains. Experimental evaluations on both real-world datasets and simulated environments show that our image-based representation consistently enhances prediction accuracy and generalization over conventional sequence-based models, underscoring the potential of cross-modal encoding strategies for robotic state learning. Our method achieves superior performance on the contact dataset, improving contact state accuracy from 87.7% to 94.5% over the recently proposed MI-HGNN method, using a 15 times shorter window size.

Gabriel Fischer Abati, Jo\~ao Carlos Virgolino Soares, Giulio Turrisi, Victor Barasuol, Claudio Semini• 2025

Related benchmarks

TaskDatasetResultRank
Contact estimationMuJoCo Trot - Stable
Left Foot Contact Accuracy (%)99.86
5
Contact estimationMuJoCo Trot - Slippery
LF Accuracy98.96
5
Contact estimationMuJoCo Trot - Fused
LF Contact Rate (%)99.36
5
Contact estimationMuJoCo (Crawl - Stable)
Contact Rate (LF)99.76
5
Contact estimationMuJoCo Crawl - Slippery
Left Foot Accuracy98.62
5
Contact estimationMuJoCo Crawl - Fused
Contact (%) - LF99.4
5
Contact estimationMIT Mini Cheetah Concrete (test)
Accuracy94.05
2
Contact estimationMIT Mini Cheetah Forest (test)
Accuracy91.09
2
Contact estimationMIT Mini Cheetah Grass (test)
Accuracy94.27
2
Contact estimationMIT Mini Cheetah Asphalt Road (test)
Accuracy95.2
2
Showing 10 of 14 rows

Other info

Follow for update