Do embodied agents dream of pixelated sheep: Embodied decision making using language guided world modelling

K Nottingham, P Ammanabrolu, A Suhr… - International …, 2023 - proceedings.mlr.press
Reinforcement learning (RL) agents typically learn tabula rasa, without prior knowledge of
the world. However, if initialized with knowledge of high-level subgoals and transitions …

Interactive natural language processing

Z Wang, G Zhang, K Yang, N Shi, W Zhou… - arxiv preprint arxiv …, 2023 - arxiv.org
Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within
the field of NLP, aimed at addressing limitations in existing frameworks while aligning with …

Skill transformer: A monolithic policy for mobile manipulation

X Huang, D Batra, A Rai, A Szot - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Abstract We present Skill Transformer, an approach for solving long-horizon robotic tasks by
combining conditional sequence modeling and skill modularity. Conditioned on egocentric …

Deep generative models for offline policy learning: Tutorial, survey, and perspectives on future directions

J Chen, B Ganguly, Y Xu, Y Mei, T Lan… - arxiv preprint arxiv …, 2024 - arxiv.org
Deep generative models (DGMs) have demonstrated great success across various domains,
particularly in generating texts, images, and videos using models trained from offline data …

Learning Generalizable Manipulation Policy with Adapter-Based Parameter Fine-Tuning

K Lu, KT Ly, W Hebberd, K Zhou… - 2024 IEEE/RSJ …, 2024 - ieeexplore.ieee.org
This study investigates the use of adapters in reinforcement learning for robotic skill
generalization across multiple robots and tasks. Traditional methods are typically reliant on …

Tail: Task-specific adapters for imitation learning with large pretrained models

Z Liu, J Zhang, K Asadi, Y Liu, D Zhao… - arxiv preprint arxiv …, 2023 - arxiv.org
The full potential of large pretrained models remains largely untapped in control domains
like robotics. This is mainly because of the scarcity of data and the computational challenges …

A Survey of Language-Based Communication in Robotics

W Hunt, SD Ramchurn, MD Soorati - arxiv preprint arxiv:2406.04086, 2024 - arxiv.org
Embodied robots which can interact with their environment and neighbours are increasingly
being used as a test case to develop Artificial Intelligence. This creates a need for …

Task-conditioned adaptation of visual features in multi-task policy learning

P Marza, L Matignon, O Simonin… - Proceedings of the …, 2024 - openaccess.thecvf.com
Successfully addressing a wide variety of tasks is a core ability of autonomous agents
requiring flexibly adapting the underlying decision-making strategies and as we argue in this …

Continual Skill and Task Learning via Dialogue

W Gu, S Kondepudi, L Huang, N Gopalan - arxiv preprint arxiv …, 2024 - arxiv.org
Continual and interactive robot learning is a challenging problem as the robot is present with
human users who expect the robot to learn novel skills to solve novel tasks perpetually with …

[PDF][PDF] Towards Deployable Reinforcement Learning: Safety, Robustness, Adaptivity, and Scalability

Z Liu - 2023 - kilthub.cmu.edu
The increasing demand to apply reinforcement learning (RL) in safety-critical domains
accentuates the essential need for safe, robust, and versatile RL algorithms. This thesis …