Binding touch to everything: Learning unified multimodal tactile representations
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …
computational systems. However multimodal learning with touch remains challenging due to …
A touch, vision, and language dataset for multimodal alignment
Canonical Representation and Force-Based Pretraining of 3D Tactile for Dexterous Visuo-Tactile Policy Learning
Tactile sensing plays a vital role in enabling robots to perform fine-grained, contact-rich
tasks. However, the high dimensionality of tactile data, due to the large coverage on …
tasks. However, the high dimensionality of tactile data, due to the large coverage on …
Signal Processing for Haptic Surface Modeling: a Review
Haptic feedback has been integrated into Virtual and Augmented Reality, complementing
acoustic and visual information and contributing to an all-round immersive experience in …
acoustic and visual information and contributing to an all-round immersive experience in …
Visuo-Tactile Pretraining for Cable Plugging
Tactile information is a critical tool for fine-grain manipulation. As humans, we rely heavily on
tactile information to understand objects in our environments and how to interact with them …
tactile information to understand objects in our environments and how to interact with them …
Low fidelity visuo-tactile pretraining improves vision-only manipulation performance
Tactile perception is a critical component of solving real-world manipulation tasks, but tactile
sensors for manipulation have barriers to use such as fragility and cost. In this work, we …
sensors for manipulation have barriers to use such as fragility and cost. In this work, we …
Touch100k: A Large-Scale Touch-Language-Vision Dataset for Touch-Centric Multimodal Representation
Touch holds a pivotal position in enhancing the perceptual and interactive capabilities of
both humans and robots. Despite its significance, current tactile research mainly focuses on …
both humans and robots. Despite its significance, current tactile research mainly focuses on …
TARS: Tactile Affordance in Robot Synesthesia for Dexterous Manipulation
In the field of dexterous robotic manipulation, integrating visual and tactile modalities to
inform manipulation policies presents significant challenges, especially in non-contact …
inform manipulation policies presents significant challenges, especially in non-contact …
Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks
This paper presents T3: Transferable Tactile Transformers, a framework for tactile
representation learning that scales across multi-sensors and multi-tasks. T3 is designed to …
representation learning that scales across multi-sensors and multi-tasks. T3 is designed to …