Modeling, learning, perception, and control methods for deformable object manipulation

H Yin, A Varava, D Kragic - Science Robotics, 2021 - science.org
Perceiving and handling deformable objects is an integral part of everyday life for humans.
Automating tasks such as food handling, garment sorting, or assistive dressing requires …

A review of physics simulators for robotic applications

J Collins, S Chand, A Vanderkop, D Howard - IEEE Access, 2021 - ieeexplore.ieee.org
The use of simulators in robotics research is widespread, underpinning the majority of recent
advances in the field. There are now more options available to researchers than ever before …

Voxposer: Composable 3d value maps for robotic manipulation with language models

W Huang, C Wang, R Zhang, Y Li, J Wu… - arxiv preprint arxiv …, 2023 - arxiv.org
Large language models (LLMs) are shown to possess a wealth of actionable knowledge that
can be extracted for robot manipulation in the form of reasoning and planning. Despite the …

Learning mesh-based simulation with graph networks

T Pfaff, M Fortunato, A Sanchez-Gonzalez… - arxiv preprint arxiv …, 2020 - arxiv.org
Mesh-based simulations are central to modeling complex physical systems in many
disciplines across science and engineering. Mesh representations support powerful …

Learning to simulate complex physics with graph networks

A Sanchez-Gonzalez, J Godwin… - International …, 2020 - proceedings.mlr.press
Here we present a machine learning framework and model implementation that can learn to
simulate a wide variety of challenging physical domains, involving fluids, rigid solids, and …

Discovering symbolic models from deep learning with inductive biases

M Cranmer, A Sanchez Gonzalez… - Advances in neural …, 2020 - proceedings.neurips.cc
We develop a general approach to distill symbolic representations of a learned deep model
by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The …

Spatio-temporal graph transformer networks for pedestrian trajectory prediction

C Yu, X Ma, J Ren, H Zhao, S Yi - … , Glasgow, UK, August 23–28, 2020 …, 2020 - Springer
Understanding crowd motion dynamics is critical to real-world applications, eg, surveillance
systems and autonomous driving. This is challenging because it requires effectively …

Graph neural networks in particle physics

J Shlomi, P Battaglia, JR Vlimant - Machine Learning: Science …, 2020 - iopscience.iop.org
Particle physics is a branch of science aiming at discovering the fundamental laws of matter
and forces. Graph neural networks are trainable functions which operate on graphs—sets of …

Rekep: Spatio-temporal reasoning of relational keypoint constraints for robotic manipulation

W Huang, C Wang, Y Li, R Zhang, L Fei-Fei - arxiv preprint arxiv …, 2024 - arxiv.org
Representing robotic manipulation tasks as constraints that associate the robot and the
environment is a promising way to encode desired robot behaviors. However, it remains …

Multipole graph neural operator for parametric partial differential equations

Z Li, N Kovachki, K Azizzadenesheli… - Advances in …, 2020 - proceedings.neurips.cc
One of the main challenges in using deep learning-based methods for simulating physical
systems and solving partial differential equations (PDEs) is formulating physics-based data …