Binding touch to everything: Learning unified multimodal tactile representations

F Yang, C Feng, Z Chen, H Park… - Proceedings of the …, 2024 - openaccess.thecvf.com
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …

Canonical Representation and Force-Based Pretraining of 3D Tactile for Dexterous Visuo-Tactile Policy Learning

T Wu, J Li, J Zhang, M Wu, H Dong - arxiv preprint arxiv:2409.17549, 2024 - arxiv.org
Tactile sensing plays a vital role in enabling robots to perform fine-grained, contact-rich
tasks. However, the high dimensionality of tactile data, due to the large coverage on …

Signal Processing for Haptic Surface Modeling: a Review

AL Stefani, N Bisagno, A Rosani, N Conci… - arxiv preprint arxiv …, 2024 - arxiv.org
Haptic feedback has been integrated into Virtual and Augmented Reality, complementing
acoustic and visual information and contributing to an all-round immersive experience in …

Visuo-Tactile Pretraining for Cable Plugging

A George, S Gano, P Katragadda… - arxiv preprint arxiv …, 2024 - arxiv.org
Tactile information is a critical tool for fine-grain manipulation. As humans, we rely heavily on
tactile information to understand objects in our environments and how to interact with them …

Low fidelity visuo-tactile pretraining improves vision-only manipulation performance

S Gano, A George, AB Farimani - arxiv preprint arxiv:2406.15639, 2024 - arxiv.org
Tactile perception is a critical component of solving real-world manipulation tasks, but tactile
sensors for manipulation have barriers to use such as fragility and cost. In this work, we …

Touch100k: A Large-Scale Touch-Language-Vision Dataset for Touch-Centric Multimodal Representation

N Cheng, C Guan, J Gao, W Wang, Y Li, F Meng… - arxiv preprint arxiv …, 2024 - arxiv.org
Touch holds a pivotal position in enhancing the perceptual and interactive capabilities of
both humans and robots. Despite its significance, current tactile research mainly focuses on …

TARS: Tactile Affordance in Robot Synesthesia for Dexterous Manipulation

Q Wu, H Wang, J Zhou, X **ong… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
In the field of dexterous robotic manipulation, integrating visual and tactile modalities to
inform manipulation policies presents significant challenges, especially in non-contact …

Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks

J Zhao, Y Ma, L Wang, EH Adelson - arxiv preprint arxiv:2406.13640, 2024 - arxiv.org
This paper presents T3: Transferable Tactile Transformers, a framework for tactile
representation learning that scales across multi-sensors and multi-tasks. T3 is designed to …