General in-hand object rotation with vision and touch
We introduce Rotateit, a system that enables fingertip-based object rotation along multiple
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …
Tactile-sensing technologies: Trends, challenges and outlook in agri-food manipulation
Tactile sensing plays a pivotal role in achieving precise physical manipulation tasks and
extracting vital physical features. This comprehensive review paper presents an in-depth …
extracting vital physical features. This comprehensive review paper presents an in-depth …
Binding touch to everything: Learning unified multimodal tactile representations
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …
computational systems. However multimodal learning with touch remains challenging due to …
NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation
To achieve human-level dexterity, robots must infer spatial awareness from multimodal
sensing to reason over contact interactions. During in-hand manipulation of novel objects …
sensing to reason over contact interactions. During in-hand manipulation of novel objects …
Robot learning in the era of foundation models: A survey
X ** multi-fingered robots with tactile sensing is crucial for achieving the precise,
contact-rich, and dexterous manipulation that humans excel at. However, relying solely on …
contact-rich, and dexterous manipulation that humans excel at. However, relying solely on …
Sequential dexterity: Chaining dexterous policies for long-horizon manipulation
Many real-world manipulation tasks consist of a series of subtasks that are significantly
different from one another. Such long-horizon, complex tasks highlight the potential of …
different from one another. Such long-horizon, complex tasks highlight the potential of …
Dynamic handover: Throw and catch with bimanual hands
Humans throw and catch objects all the time. However, such a seemingly common skill
introduces a lot of challenges for robots to achieve: The robots need to operate such …
introduces a lot of challenges for robots to achieve: The robots need to operate such …