Making sense of vision and touch: Learning multimodal representations for contact-rich tasks

MA Lee, Y Zhu, P Zachares, M Tan… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
Contact-rich manipulation tasks in unstructured environments often require both haptic and
visual feedback. It is nontrivial to manually design a robot controller that combines these …

Tactile-rl for insertion: Generalization to objects of unknown geometry

S Dong, DK Jha, D Romeres, S Kim… - … on Robotics and …, 2021 - ieeexplore.ieee.org
Object insertion is a classic contact-rich manipulation task. The task remains challenging,
especially when considering general objects of unknown geometry, which significantly limits …

Deeply supervised subspace learning for cross-modal material perception of known and unknown objects

P **ong, J Liao, MC Zhou, A Song… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
In order to help robots understand and perceive an object's properties during noncontact
robot-object interaction, this article proposes a deeply supervised subspace learning …

Active extrinsic contact sensing: Application to general peg-in-hole insertion

S Kim, A Rodriguez - 2022 International Conference on …, 2022 - ieeexplore.ieee.org
We propose a method that actively estimates contact location between a grasped rigid
object and its environment and uses this as input to a peg-in-hole insertion policy. An …

Extrinsic contact sensing with relative-motion tracking from distributed tactile measurements

D Ma, S Dong, A Rodriguez - 2021 IEEE international …, 2021 - ieeexplore.ieee.org
This paper addresses the localization of contacts of an unknown grasped rigid object with its
environment, ie, extrinsic to the robot. We explore the key role that distributed tactile sensing …

Learning tactile models for factor graph-based estimation

P Sodhi, M Kaess, M Mukadam… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
We're interested in the problem of estimating object states from touch during manipulation
under occlusions. In this work, we address the problem of estimating object poses from …

Manipulation of unknown objects via contact configuration regulation

N Doshi, O Taylor, A Rodriguez - … International Conference on …, 2022 - ieeexplore.ieee.org
We present an approach to robotic manipulation of unknown objects through regulation of
the object's contact configuration: the location, geometry, and mode of all contacts between …

A residual reinforcement learning method for robotic assembly using visual and force information

Z Zhang, Y Wang, Z Zhang, L Wang, H Huang… - Journal of Manufacturing …, 2024 - Elsevier
Robotic autonomous assembly is critical in intelligent manufacturing and has always been a
research hotspot. Most previous approaches rely on prior knowledge, such as geometric …

Dense robotic packing of irregular and novel 3D objects

F Wang, K Hauser - IEEE Transactions on Robotics, 2021 - ieeexplore.ieee.org
Recent progress in the field of robotic manipulation has generated interest in fully automatic
object packing in warehouses. This article presents a formulation of the robotic packing …

Differentiable factor graph optimization for learning smoothers

B Yi, MA Lee, A Kloss, R Martín-Martín… - 2021 IEEE/RSJ …, 2021 - ieeexplore.ieee.org
A recent line of work has shown that end-to-end optimization of Bayesian filters can be used
to learn state estimators for systems whose underlying models are difficult to hand-design or …