Visuotactile sensors with emphasis on gelsight sensor: A review

AC Abad, A Ranasinghe - IEEE Sensors Journal, 2020 - ieeexplore.ieee.org
This review paper focuses on vision and touch-based sensors known as visuotactile. The
study of visuotactile sensation and perception became a multidisciplinary field of study by …

Multimodality helps unimodality: Cross-modal few-shot learning with multimodal models

Z Lin, S Yu, Z Kuang, D Pathak… - Proceedings of the …, 2023 - openaccess.thecvf.com
The ability to quickly learn a new task with minimal instruction-known as few-shot learning-is
a central aspect of intelligent agents. Classical few-shot benchmarks make use of few-shot …

Visuo-haptic object perception for robots: an overview

N Navarro-Guerrero, S Toprak, J Josifovski… - Autonomous …, 2023 - Springer
The object perception capabilities of humans are impressive, and this becomes even more
evident when trying to develop solutions with a similar proficiency in autonomous robots …

Making sense of vision and touch: Learning multimodal representations for contact-rich tasks

MA Lee, Y Zhu, P Zachares, M Tan… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
Contact-rich manipulation tasks in unstructured environments often require both haptic and
visual feedback. It is nontrivial to manually design a robot controller that combines these …

The objectfolder benchmark: Multisensory learning with neural and real objects

R Gao, Y Dou, H Li, T Agarwal, J Bohg… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract We introduce the ObjectFolder Benchmark, a benchmark suite of 10 tasks for
multisensory object-centric learning, centered around object recognition, reconstruction, and …

Generation of gelsight tactile images for sim2real learning

DF Gomes, P Paoletti, S Luo - IEEE Robotics and Automation …, 2021 - ieeexplore.ieee.org
Most current works in Sim2Real learning for robotic manipulation tasks leverage camera
vision that may be significantly occluded by robot hands during the manipulation. Tactile …

GelTip: A finger-shaped optical tactile sensor for robotic manipulation

DF Gomes, Z Lin, S Luo - 2020 IEEE/RSJ International …, 2020 - ieeexplore.ieee.org
Sensing contacts throughout the fingers is an essential capability for a robot to perform
manipulation tasks in cluttered environments. However, existing tactile sensors either only …

Touching a nerf: Leveraging neural radiance fields for tactile sensory data generation

S Zhong, A Albini, OP Jones… - … on Robot Learning, 2023 - proceedings.mlr.press
Tactile perception is key for robotics applications such as manipulation. However, tactile
data collection is time-consuming, especially when compared to vision. This limits the use of …

Intelligent carpet: Inferring 3d human pose from tactile signals

Y Luo, Y Li, M Foshey, W Shou… - Proceedings of the …, 2021 - openaccess.thecvf.com
Daily human activities, eg, locomotion, exercises, and resting, are heavily guided by the
tactile interactions between the human and the ground. In this work, leveraging such tactile …

Sim-to-real for robotic tactile sensing via physics-based simulation and learned latent projections

Y Narang, B Sundaralingam, M Macklin… - … on Robotics and …, 2021 - ieeexplore.ieee.org
Tactile sensing is critical for robotic gras** and manipulation of objects under visual
occlusion. However, in contrast to simulations of robot arms and cameras, current …