Transformers, originally devised for natural language processing (NLP), have also produced
significant successes in computer vision (CV). Due to their strong expression power …

Reinforcement learning from human feedback (RLHF) can improve the quality of large
language model's (LLM) outputs by aligning them with human preferences. We propose a …

Inspired by progress in large-scale language modeling, we apply a similar approach
towards building a single generalist agent beyond the realm of text outputs. The agent …

The grand aim of having a single robot that can manipulate arbitrary objects in diverse
settings is at odds with the paucity of robotics datasets. Acquiring and growing such datasets …

Experience-related brain activity patterns reactivate during sleep, wakeful rest, and brief
pauses from active behavior. In parallel, machine learning research has found that …

Collaborating with humans requires rapidly adapting to their individual strengths,
weaknesses, and preferences. Unfortunately, most standard multi-agent reinforcement …

Animals have exquisite control of their bodies, allowing them to perform a diverse range of
behaviours. How such control is implemented by the brain, however, remains unclear …

Owing to their ability to both effectively integrate information over long time horizons and
scale to massive amounts of data, self-attention architectures have recently shown …

In recent years, on-policy reinforcement learning (RL) has been successfully applied to
many different continuous control tasks. While RL algorithms are often conceptually simple …

In recent years, reinforcement learning (RL) has been successfully applied to many different
continuous control tasks. While RL algorithms are often conceptually simple, their state-of …