A Comprehensive Survey on Inverse Constrained Reinforcement Learning: Definitions, Progress and Challenges

G Liu, S Xu, S Liu, A Gaurav, SG Subramanian… - arxiv preprint arxiv …, 2024 - arxiv.org
Inverse Constrained Reinforcement Learning (ICRL) is the task of inferring the implicit
constraints followed by expert agents from their demonstration data. As an emerging …

Deep generative models in robotics: A survey on learning from multimodal demonstrations

J Urain, A Mandlekar, Y Du, M Shafiullah, D Xu… - arxiv preprint arxiv …, 2024 - arxiv.org
Learning from Demonstrations, the field that proposes to learn robot behavior models from
data, is gaining popularity with the emergence of deep generative models. Although the …

Vlm see, robot do: Human demo video to robot action plan via vision language model

B Wang, J Zhang, S Dong, I Fang, C Feng - arxiv preprint arxiv …, 2024 - arxiv.org
Vision Language Models (VLMs) have recently been adopted in robotics for their capability
in common sense reasoning and generalizability. Existing work has applied VLMs to …

Robotwin: Dual-arm robot benchmark with generative digital twins (early version)

Y Mu, T Chen, S Peng, Z Chen, Z Gao, Y Zou… - arxiv preprint arxiv …, 2024 - arxiv.org
Effective collaboration of dual-arm robots and their tool use capabilities are increasingly
important areas in the advancement of robotics. These skills play a significant role in …

Bigym: A demo-driven mobile bi-manual manipulation benchmark

N Chernyadev, N Backshall, X Ma, Y Lu, Y Seo… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce BiGym, a new benchmark and learning environment for mobile bi-manual
demo-driven robotic manipulation. BiGym features 40 diverse tasks set in home …

Dexmimicgen: Automated data generation for bimanual dexterous manipulation via imitation learning

Z Jiang, Y **e, K Lin, Z Xu, W Wan, A Mandlekar… - arxiv preprint arxiv …, 2024 - arxiv.org
Imitation learning from human demonstrations is an effective means to teach robots
manipulation skills. But data acquisition is a major bottleneck in applying this paradigm more …

Re-mix: Optimizing data mixtures for large scale imitation learning

J Hejna, C Bhateja, Y Jian, K Pertsch… - arxiv preprint arxiv …, 2024 - arxiv.org
Increasingly large imitation learning datasets are being collected with the goal of training
foundation models for robotics. However, despite the fact that data selection has been of …

Maniskill3: Gpu parallelized robotics simulation and rendering for generalizable embodied ai

S Tao, F **ang, A Shukla, Y Qin, X Hinrichsen… - arxiv preprint arxiv …, 2024 - arxiv.org
Simulation has enabled unprecedented compute-scalable approaches to robot learning.
However, many existing simulation frameworks typically support a narrow range of …

Gensim2: Scaling robot data generation with multi-modal and reasoning llms

P Hua, M Liu, A Macaluso, Y Lin, W Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
Robotic simulation today remains challenging to scale up due to the human efforts required
to create diverse simulation tasks and scenes. Simulation-trained policies also face …

InfiniteWorld: A Unified Scalable Simulation Framework for General Visual-Language Robot Interaction

P Ren, M Li, Z Luo, X Song, Z Chen, W Liufu… - arxiv preprint arxiv …, 2024 - arxiv.org
Realizing scaling laws in embodied AI has become a focus. However, previous work has
been scattered across diverse simulation platforms, with assets and models lacking unified …