Integrated task and motion planning

CR Garrett, R Chitnis, R Holladay, B Kim… - Annual review of …, 2021 - annualreviews.org
The problem of planning for a robot that operates in environments containing a large
number of objects, taking actions to move itself through the world as well as to change the …

From machine learning to robotics: Challenges and opportunities for embodied intelligence

N Roy, I Posner, T Barfoot, P Beaudoin… - arxiv preprint arxiv …, 2021 - arxiv.org
Machine learning has long since become a keystone technology, accelerating science and
applications in a broad range of domains. Consequently, the notion of applying learning …

Text2motion: From natural language instructions to feasible plans

K Lin, C Agia, T Migimatsu, M Pavone, J Bohg - Autonomous Robots, 2023 - Springer
Abstract We propose Text2Motion, a language-based planning framework enabling robots
to solve sequential manipulation tasks that require long-horizon reasoning. Given a natural …

Inner monologue: Embodied reasoning through planning with language models

W Huang, F **a, T **ao, H Chan, J Liang… - arxiv preprint arxiv …, 2022 - arxiv.org
Recent works have shown how the reasoning capabilities of Large Language Models
(LLMs) can be applied to domains beyond natural language processing, such as planning …

Do as i can, not as i say: Grounding language in robotic affordances

M Ahn, A Brohan, N Brown, Y Chebotar… - arxiv preprint arxiv …, 2022 - arxiv.org
Large language models can encode a wealth of semantic knowledge about the world. Such
knowledge could be extremely useful to robots aiming to act upon high-level, temporally …

Rekep: Spatio-temporal reasoning of relational keypoint constraints for robotic manipulation

W Huang, C Wang, Y Li, R Zhang, L Fei-Fei - arxiv preprint arxiv …, 2024 - arxiv.org
Representing robotic manipulation tasks as constraints that associate the robot and the
environment is a promising way to encode desired robot behaviors. However, it remains …

Generative skill chaining: Long-horizon skill planning with diffusion models

UA Mishra, S Xue, Y Chen… - Conference on Robot …, 2023 - proceedings.mlr.press
Long-horizon tasks, usually characterized by complex subtask dependencies, present a
significant challenge in manipulation planning. Skill chaining is a practical approach to …

Grounded decoding: Guiding text generation with grounded models for robot control

W Huang, F **a, D Shah, D Driess, A Zeng, Y Lu… - arxiv preprint arxiv …, 2023 - arxiv.org
Recent progress in large language models (LLMs) has demonstrated the ability to learn and
leverage Internet-scale knowledge through pre-training with autoregressive models …

Efficient multitask learning with an embodied predictive model for door opening and entry with whole-body control

H Ito, K Yamamoto, H Mori, T Ogata - Science Robotics, 2022 - science.org
Robots need robust models to effectively perform tasks that humans do on a daily basis.
These models often require substantial developmental costs to maintain because they need …

Differentiable physics and stable modes for tool-use and manipulation planning

MA Toussaint, KR Allen, KA Smith, JB Tenenbaum - 2018 - dspace.mit.edu
We consider the problem of sequential manipulationand tool-use planning in domains that
include physical interac-tions such as hitting and throwing. The approach integrates aTask …