BiView-Touch: Learning Bimanual Tactile Representations by Cross-Hand Completion
cs.CV, cs.RO
Submitted: 2026-09-20
Updated: 2026-09-20
Comments: Submitted to ICRA 2027; 9 pages, 7 figures
Project page: https://anonymous.4open.science/w/biview-touch-review-site-050C
License: http://creativecommons.org/licenses/by/4.0/
The gist: Bimanual interaction produces complementary tactile views of the same physical process, yet existing tactile representation learning largely models the two hands independently or combines them only
Terminology
Abstract
Bimanual interaction produces complementary tactile views of the same physical process, yet existing tactile representation learning largely models the two hands independently or combines them only for downstream prediction, leaving their cross-hand relationship unexplored. To exploit this overlooked structure, we introduce BiView-Touch, a tactile-only framework that completes masked target-hand latents from the remaining visible target-hand regions and the synchronized full contralateral hand. A student encoder with a geometry-conditioned directional decoder predicts full-view EMA latent targets, while temporal and layout counterfactuals encourage sensitivity to synchronized and anatomically organized source information. Controlled ablations and source-context interventions show that BiView-Touch learns structured cross-hand dependence on temporally aligned and anatomically organized contralateral tactile context, rather than benefiting from bilateral input alone. On the public HumanTouch dataset, its frozen representations consistently outperform representative self-supervised baselines across low-label settings. With only 5% downstream labels, BiView-Touch achieves relative balanced-accuracy gains of 7.1% on bilateral wrist-motion recognition and 14.1% on force-derived interaction-phase recognition. We further introduce BVT-20, a 20-task bilateral tactile dataset, and demonstrate transfer across recording sessions and pretraining corpora, including transfer to a held-out bimanual task. Our code and dataset details are available on the anonymous project page: https://anonymous.4open.science/w/biview-touch-review-site-050C/.
Sources
- exUMI: Extensible Robot Teaching System with Action-aware Task-agnostic Tactile Representation
- STAR: Sparse Tactile Representation Learning in Vision-Tactile-Language-Action Models for Dexterous Manipulation
- Blind Dexterous Grasping via Real2Sim2Real Tactile Policy Learning
- TouchAnything: A Dataset and Framework for Bimanual Tactile Estimation from Egocentric Video
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models