Evaluating Tactile Foundation Models for End-to-End Imitation Learning in Contact-Rich Manipulation
cs.RO
Submitted: 2026-10-31
Updated: 2026-10-31
Comments: Accepted for the 2027 IEEE/SICE International Symposium on System Integration (SII 2027)
Project page: https://mmurooka.github.io/tfm4il-project-page
License: http://creativecommons.org/licenses/by/4.0/
The gist: Tactile sensing plays an important role in imitation learning for contact-rich manipulation by providing direct observations of physical contact with objects.
Terminology
Abstract
Tactile sensing plays an important role in imitation learning for contact-rich manipulation by providing direct observations of physical contact with objects. Recently, several tactile foundation models (TFMs) have been proposed to learn general-purpose tactile representations through pretraining on large-scale tactile datasets. However, how these pretrained tactile representations should be leveraged for end-to-end imitation learning remains insufficiently explored. In this work, we integrate multiple TFMs into Diffusion Policy and systematically evaluate their effectiveness for contact-rich manipulation under common experimental settings. We further investigate adaptation strategies, including encoder fine-tuning and task-specific mid-training, to understand how pretrained tactile representations can be effectively used for downstream imitation learning. Through extensive evaluation across diverse manipulation tasks in both real-world and simulation environments, including more than 5,000 real-world policy rollouts, we provide empirical insights into the use of TFMs for end-to-end imitation learning. Project page: https://mmurooka.github.io/tfm4il-project-page/
Sources
- Tactile-Conditioned Diffusion Policy for Force-Aware Robotic Manipulation
- Representation Learning with Contrastive Predictive Coding
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation