Sornet: Spatial object-centric representations for sequential manipulation

W Yuan, C Paxton, K Desingh… - Conference on Robot …, 2022 - proceedings.mlr.press
Sequential manipulation tasks require a robot to perceive the state of an environment and
plan a sequence of actions leading to a desired goal state, where the ability to reason about …

Structdiffusion: Object-centric diffusion for semantic rearrangement of novel objects

W Liu, T Hermans, S Chernova… - Workshop on Language …, 2022 - openreview.net
Robots operating in human environments must be able to rearrange objects into
semantically-meaningful configurations, even if these objects are previously unseen. In this …

Virdo: Visio-tactile implicit representations of deformable objects

Y Wi, P Florence, A Zeng… - … Conference on Robotics …, 2022 - ieeexplore.ieee.org
Deformable object manipulation requires computationally efficient representations that are
compatible with robotic sensing modalities. In this paper, we present VIRDO: an implicit …

Predicting stable configurations for semantic placement of novel objects

C Paxton, C **e, T Hermans… - Conference on robot …, 2022 - proceedings.mlr.press
Human environments contain numerous objects configured in a variety of arrangements.
Our goal is to enable robots to repose previously unseen objects according to learned …

Planning for multi-object manipulation with graph neural network relational classifiers

Y Huang, A Conkey, T Hermans - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Objects rarely sit in isolation in human environments. As such, we'd like our robots to reason
about how multiple objects relate to one another and how those relations may change as the …

StructDiffusion: Language-guided creation of physically-valid structures using unseen objects

W Liu, Y Du, T Hermans, S Chernova… - arxiv preprint arxiv …, 2022 - arxiv.org
Robots operating in human environments must be able to rearrange objects into
semantically-meaningful configurations, even if these objects are previously unseen. In this …

Out of sight, still in mind: Reasoning and planning about unobserved objects with video tracking enabled memory models

Y Huang, J Yuan, C Kim, P Pradhan… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Robots need to have a memory of previously observed, but currently occluded objects to
work reliably in realistic environments. We investigate the problem of encoding object …

Unsupervised object interaction learning with counterfactual dynamics models

J Choi, S Lee, X Wang, S Sohn, H Lee - Proceedings of the AAAI …, 2024 - ojs.aaai.org
We present COIL (Counterfactual Object Interaction Learning), a novel way of learning skills
of object interactions on entity-centric environments. The goal is to learn primitive behaviors …

Latent space planning for multi-object manipulation with environment-aware relational classifiers

Y Huang, NC Taylor, A Conkey, W Liu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Objects rarely sit in isolation in everyday human environments. If we want robots to operate
and perform tasks in our human environments, they must understand how the objects they …

Synergistic scheduling of learning and allocation of tasks in human-robot teams

S Vats, O Kroemer, M Likhachev - … International Conference on …, 2022 - ieeexplore.ieee.org
We consider the problem of completing a set of n tasks with a human-robot team using
minimum effort. In many domains, teaching a robot to be fully autonomous can be …