General in-hand object rotation with vision and touch

H Qi, B Yi, S Suresh, M Lambeta, Y Ma… - … on Robot Learning, 2023 - proceedings.mlr.press
We introduce Rotateit, a system that enables fingertip-based object rotation along multiple
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …

Tactile-sensing technologies: Trends, challenges and outlook in agri-food manipulation

W Mandil, V Rajendran, K Nazari… - Sensors, 2023 - mdpi.com
Tactile sensing plays a pivotal role in achieving precise physical manipulation tasks and
extracting vital physical features. This comprehensive review paper presents an in-depth …

Binding touch to everything: Learning unified multimodal tactile representations

F Yang, C Feng, Z Chen, H Park… - Proceedings of the …, 2024 - openaccess.thecvf.com
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …

NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation

S Suresh, H Qi, T Wu, T Fan, L Pineda, M Lambeta… - Science Robotics, 2024 - science.org
To achieve human-level dexterity, robots must infer spatial awareness from multimodal
sensing to reason over contact interactions. During in-hand manipulation of novel objects …

Robot learning in the era of foundation models: A survey

X ** multi-fingered robots with tactile sensing is crucial for achieving the precise,
contact-rich, and dexterous manipulation that humans excel at. However, relying solely on …

Sequential dexterity: Chaining dexterous policies for long-horizon manipulation

Y Chen, C Wang, L Fei-Fei, CK Liu - arxiv preprint arxiv:2309.00987, 2023 - arxiv.org
Many real-world manipulation tasks consist of a series of subtasks that are significantly
different from one another. Such long-horizon, complex tasks highlight the potential of …

Dynamic handover: Throw and catch with bimanual hands

B Huang, Y Chen, T Wang, Y Qin, Y Yang… - arxiv preprint arxiv …, 2023 - arxiv.org
Humans throw and catch objects all the time. However, such a seemingly common skill
introduces a lot of challenges for robots to achieve: The robots need to operate such …