Self-supervised learning of state estimation for manipulating deformable linear objects

M Yan, Y Zhu, N **, J Bohg - IEEE robotics and automation …, 2020 - ieeexplore.ieee.org
We demonstrate model-based, visual robot manipulation of deformable linear objects. Our
approach is based on a state-space representation of the physical system that the robot …

Grounding Intuitive Physics in Perceptual Experience

M Vicovaro - Journal of Intelligence, 2023 - mdpi.com
This review article explores the foundation of laypeople's understanding of the physical
world rooted in perceptual experience. Beginning with a concise historical overview of the …

Structured object-aware physics prediction for video modeling and planning

J Kossen, K Stelzner, M Hussing, C Voelcker… - arxiv preprint arxiv …, 2019 - arxiv.org
When humans observe a physical system, they can easily locate objects, understand their
interactions, and anticipate future behavior, even in settings with complicated and previously …

Causalcity: Complex simulations with agency for causal discovery and reasoning

D McDuff, Y Song, J Lee, V Vineet… - … on Causal Learning …, 2022 - proceedings.mlr.press
The ability to perform causal and counterfactual reasoning are central properties of human
intelligence. Decision-making systems that can perform these types of reasoning have the …

Sim-to-real transfer learning using robustified controllers in robotic tasks involving complex dynamics

J Van Baar, A Sullivan, R Cordorel… - … on Robotics and …, 2019 - ieeexplore.ieee.org
Learning robot tasks or controllers using deep reinforcement learning has been proven
effective in simulations. Learning in simulation has several advantages. For example, one …

Physics-as-inverse-graphics: Unsupervised physical parameter estimation from video

M Jaques, M Burke, T Hospedales - arxiv preprint arxiv:1905.11169, 2019 - arxiv.org
We propose a model that is able to perform unsupervised physical parameter estimation of
systems from video, where the differential equations governing the scene dynamics are …

Operationally meaningful representations of physical systems in neural networks

HP Nautrup, T Metger, R Iten, S Jerbi… - Machine Learning …, 2022 - iopscience.iop.org
To make progress in science, we often build abstract representations of physical systems
that meaningfully encode information about the systems. Such representations ignore …

Distilling governing laws and source input for dynamical systems from videos

L Luan, Y Liu, H Sun - arxiv preprint arxiv:2205.01314, 2022 - arxiv.org
Distilling interpretable physical laws from videos has led to expanded interest in the
computer vision community recently thanks to the advances in deep learning, but still …

[PDF][PDF] Physics-as-inverse-graphics: Joint unsupervised learning of objects and physics from video

M Jaques, M Burke, T Hospedales - arxiv preprint arxiv …, 2019 - researchgate.net
We aim to perform unsupervised discovery of objects and their states such as location and
velocity, as well as physical system parameters such as mass and gravity from video–given …

[HTML][HTML] Taking visual motion prediction to new heightfields

S Ehrhardt, A Monszpart, NJ Mitra, A Vedaldi - Computer Vision and Image …, 2019 - Elsevier
While the basic laws of Newtonian mechanics are well understood, explaining a physical
scenario still requires manually modeling the problem with suitable equations and …