A survey of optimization-based task and motion planning: From classical to learning approaches

Z Zhao, S Cheng, Y Ding, Z Zhou… - IEEE/ASME …, 2024 - ieeexplore.ieee.org
Task and motion planning (TAMP) integrates high-level task planning and low-level motion
planning to equip robots with the autonomy to effectively reason over long-horizon, dynamic …

Toward general-purpose robots via foundation models: A survey and meta-analysis

Y Hu, Q **e, V Jain, J Francis, J Patrikar… - arxiv preprint arxiv …, 2023 - arxiv.org
Building general-purpose robots that operate seamlessly in any environment, with any
object, and utilizing various skills to complete diverse tasks has been a long-standing goal in …

Zero-shot robotic manipulation with pretrained image-editing diffusion models

K Black, M Nakamoto, P Atreya, H Walke… - arxiv preprint arxiv …, 2023 - arxiv.org
If generalist robots are to operate in truly unstructured environments, they need to be able to
recognize and reason about novel objects and scenarios. Such objects and scenarios might …

Video language planning

Y Du, M Yang, P Florence, F **a, A Wahid… - arxiv preprint arxiv …, 2023 - arxiv.org
We are interested in enabling visual planning for complex long-horizon tasks in the space of
generated videos and language, leveraging recent advances in large generative models …

Provable guarantees for generative behavior cloning: Bridging low-level stability and high-level behavior

A Block, A Jadbabaie, D Pfrommer… - Advances in …, 2024 - proceedings.neurips.cc
We propose a theoretical framework for studying behavior cloning of complex expert
demonstrations using generative modeling. Our framework invokes low-level controllers …

Learning dynamic attribute-factored world models for efficient multi-object reinforcement learning

F Feng, S Magliacane - Advances in Neural Information …, 2024 - proceedings.neurips.cc
In many reinforcement learning tasks, the agent has to learn to interact with many objects of
different types and generalize to unseen combinations and numbers of objects. Often a task …

Language-driven 6-dof grasp detection using negative prompt guidance

T Nguyen, MN Vu, B Huang, A Vuong, Q Vuong… - … on Computer Vision, 2024 - Springer
DoF grasp detection has been a fundamental and challenging problem in robotic vision.
While previous works have focused on ensuring grasp stability, they often do not consider …

Deep generative models in robotics: A survey on learning from multimodal demonstrations

J Urain, A Mandlekar, Y Du, M Shafiullah, D Xu… - arxiv preprint arxiv …, 2024 - arxiv.org
Learning from Demonstrations, the field that proposes to learn robot behavior models from
data, is gaining popularity with the emergence of deep generative models. Although the …

3d diffuser actor: Policy diffusion with 3d scene representations

TW Ke, N Gkanatsios, K Fragkiadaki - arxiv preprint arxiv:2402.10885, 2024 - arxiv.org
We marry diffusion policies and 3D scene representations for robot manipulation. Diffusion
policies learn the action distribution conditioned on the robot and environment state using …

Agentgen: Enhancing planning abilities for large language model based agent via environment and task generation

M Hu, P Zhao, C Xu, Q Sun, J Lou, Q Lin, P Luo… - arxiv preprint arxiv …, 2024 - arxiv.org
Large Language Model (LLM) based agents have garnered significant attention and are
becoming increasingly popular. Furthermore, planning ability is a crucial component of an …