Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial General
Intelligence (AGI) and serves as a foundation for various applications that bridge cyberspace …

The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …

We present a scene representation that brings vision and touch into a shared 3D space
which we call a tactile-augmented radiance field. This representation capitalizes on two key …

An emerging line of work has sought to generate plausible imagery from touch. Existing
approaches, however, tackle only narrow aspects of the visuo-tactile synthesis problem, and …

Human beings possess the capability to multiply a melange of multisensory cues while
actively exploring and interacting with the 3D world. Current multi-modal large language …

Audio signals provide rich information for the robot interaction and object properties through
contact. These information can surprisingly ease the learning of contact-rich robot …

Physical reasoning is important for effective robot manipulation. Recent work has
investigated both vision and language modalities for physical reasoning; vision can reveal …

Touch and vision go hand in hand, mutually enhancing our ability to understand the world.
From a research perspective, the problem of mixing touch and vision is underexplored and …

Tactile feedback is critical for understanding the dynamics of both rigid and deformable
objects in many manipulation tasks, such as non-prehensile manipulation and dense …

Today's touch sensors come in many shapes and sizes. This has made it challenging to
develop general-purpose touch processing methods since models are generally tied to one …