Integrated task and motion planning
The problem of planning for a robot that operates in environments containing a large
number of objects, taking actions to move itself through the world as well as to change the …
number of objects, taking actions to move itself through the world as well as to change the …
From machine learning to robotics: Challenges and opportunities for embodied intelligence
Machine learning has long since become a keystone technology, accelerating science and
applications in a broad range of domains. Consequently, the notion of applying learning …
applications in a broad range of domains. Consequently, the notion of applying learning …
Text2motion: From natural language instructions to feasible plans
Abstract We propose Text2Motion, a language-based planning framework enabling robots
to solve sequential manipulation tasks that require long-horizon reasoning. Given a natural …
to solve sequential manipulation tasks that require long-horizon reasoning. Given a natural …
Inner monologue: Embodied reasoning through planning with language models
Recent works have shown how the reasoning capabilities of Large Language Models
(LLMs) can be applied to domains beyond natural language processing, such as planning …
(LLMs) can be applied to domains beyond natural language processing, such as planning …
Do as i can, not as i say: Grounding language in robotic affordances
Large language models can encode a wealth of semantic knowledge about the world. Such
knowledge could be extremely useful to robots aiming to act upon high-level, temporally …
knowledge could be extremely useful to robots aiming to act upon high-level, temporally …
Rekep: Spatio-temporal reasoning of relational keypoint constraints for robotic manipulation
Representing robotic manipulation tasks as constraints that associate the robot and the
environment is a promising way to encode desired robot behaviors. However, it remains …
environment is a promising way to encode desired robot behaviors. However, it remains …
Generative skill chaining: Long-horizon skill planning with diffusion models
Long-horizon tasks, usually characterized by complex subtask dependencies, present a
significant challenge in manipulation planning. Skill chaining is a practical approach to …
significant challenge in manipulation planning. Skill chaining is a practical approach to …
Grounded decoding: Guiding text generation with grounded models for robot control
Recent progress in large language models (LLMs) has demonstrated the ability to learn and
leverage Internet-scale knowledge through pre-training with autoregressive models …
leverage Internet-scale knowledge through pre-training with autoregressive models …
Efficient multitask learning with an embodied predictive model for door opening and entry with whole-body control
Robots need robust models to effectively perform tasks that humans do on a daily basis.
These models often require substantial developmental costs to maintain because they need …
These models often require substantial developmental costs to maintain because they need …
Differentiable physics and stable modes for tool-use and manipulation planning
We consider the problem of sequential manipulationand tool-use planning in domains that
include physical interac-tions such as hitting and throwing. The approach integrates aTask …
include physical interac-tions such as hitting and throwing. The approach integrates aTask …