Towards continual reinforcement learning: A review and perspectives

K Khetarpal, M Riemer, I Rish, D Precup - Journal of Artificial Intelligence …, 2022 - jair.org
In this article, we aim to provide a literature review of different formulations and approaches
to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We …

Concepts and compositionality: in search of the brain's language of thought

SM Frankland, JD Greene - Annual review of psychology, 2020 - annualreviews.org
Imagine Genghis Khan, Aretha Franklin, and the Cleveland Cavaliers performing an opera
on Maui. This silly sentence makes a serious point: As humans, we can flexibly generate …

Multi-task learning with deep neural networks: A survey

M Crawshaw - arxiv preprint arxiv:2009.09796, 2020 - arxiv.org
Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are
simultaneously learned by a shared model. Such approaches offer advantages like …

Modular deep learning

J Pfeiffer, S Ruder, I Vulić, EM Ponti - arxiv preprint arxiv:2302.11529, 2023 - arxiv.org
Transfer learning has recently become the dominant paradigm of machine learning. Pre-
trained models fine-tuned for downstream tasks achieve better performance with fewer …

Detecting stance in media on global warming

Y Luo, D Card, D Jurafsky - arxiv preprint arxiv:2010.15149, 2020 - arxiv.org
Citing opinions is a powerful yet understudied strategy in argumentation. For example, an
environmental activist might say," Leading scientists agree that global warming is a serious …

Routing networks and the challenges of modular and compositional computation

C Rosenbaum, I Cases, M Riemer, T Klinger - arxiv preprint arxiv …, 2019 - arxiv.org
Compositionality is a key strategy for addressing combinatorial complexity and the curse of
dimensionality. Recent work has shown that compositional solutions can be learned and …

Realtime reinforcement learning: Towards rapid asynchronous deployment of large models

M Riemer, G Subbaraj, G Berseth… - The Thirteenth International …, 2024 - openreview.net
Realtime environments change even as agents perform action inference and learning, thus
requiring high interaction frequencies to effectively minimize long-term regret. However …

How well do NLI models capture verb veridicality?

A Ross, E Pavlick - Proceedings of the 2019 Conference on …, 2019 - aclanthology.org
In natural language inference (NLI), contexts are considered veridical if they allow us to infer
that their underlying propositions make true claims about the real world. We investigate …

Relational reasoning and generalization using nonsymbolic neural networks.

A Geiger, A Carstensen, MC Frank, C Potts - Psychological Review, 2023 - psycnet.apa.org
The notion of equality (identity) is simple and ubiquitous, making it a key case study for
broader questions about the representations supporting abstract relational reasoning …

On the role of weight sharing during deep option learning

M Riemer, I Cases, C Rosenbaum, M Liu… - Proceedings of the AAAI …, 2020 - ojs.aaai.org
The options framework is a popular approach for building temporally extended actions in
reinforcement learning. In particular, the option-critic architecture provides general purpose …