Model-based multi-agent reinforcement learning: Recent progress and prospects

X Wang, Z Zhang, W Zhang - arxiv preprint arxiv:2203.10603, 2022 - arxiv.org
Significant advances have recently been achieved in Multi-Agent Reinforcement Learning
(MARL) which tackles sequential decision-making problems involving multiple participants …

[PDF][PDF] Learning mean field games: A survey

M Laurière, S Perrin, M Geist… - arxiv preprint arxiv …, 2022 - researchgate.net
Non-cooperative and cooperative games with a very large number of players have many
applications but remain generally intractable when the number of players increases …

A survey of progress on cooperative multi-agent reinforcement learning in open environment

L Yuan, Z Zhang, L Li, C Guan, Y Yu - arxiv preprint arxiv:2312.01058, 2023 - arxiv.org
Multi-agent Reinforcement Learning (MARL) has gained wide attention in recent years and
has made progress in various fields. Specifically, cooperative MARL focuses on training a …

Model-free mean-field reinforcement learning: mean-field MDP and mean-field Q-learning

R Carmona, M Laurière, Z Tan - The Annals of Applied Probability, 2023 - projecteuclid.org
We study infinite horizon discounted mean field control (MFC) problems with common noise
through the lens of mean field Markov decision processes (MFMDP). We allow the agents to …

Efficient exploration in continuous-time model-based reinforcement learning

L Treven, J Hübotter, B Sukhija… - Advances in Neural …, 2023 - proceedings.neurips.cc
Reinforcement learning algorithms typically consider discrete-time dynamics, even though
the underlying systems are often continuous in time. In this paper, we introduce a model …

Optimistic active exploration of dynamical systems

L Treven, C Sancaktar, S Blaes… - Advances in Neural …, 2023 - proceedings.neurips.cc
Reinforcement learning algorithms commonly seek to optimize policies for solving one
particular task. How should we explore an unknown dynamical system such that the …

Learning graphon mean field games and approximate nash equilibria

K Cui, H Koeppl - arxiv preprint arxiv:2112.01280, 2021 - arxiv.org
Recent advances at the intersection of dense large graph limits and mean field games have
begun to enable the scalable analysis of a broad class of dynamical sequential games with …

On the approximation of cooperative heterogeneous multi-agent reinforcement learning (marl) using mean field control (mfc)

WU Mondal, M Agarwal, V Aggarwal… - Journal of Machine …, 2022 - jmlr.org
Mean field control (MFC) is an effective way to mitigate the curse of dimensionality of
cooperative multi-agent reinforcement learning (MARL) problems. This work considers a …

A general framework for learning mean-field games

X Guo, A Hu, R Xu, J Zhang - Mathematics of Operations …, 2023 - pubsonline.informs.org
This paper presents a general mean-field game (GMFG) framework for simultaneous
learning and decision making in stochastic games with a large population. It first establishes …

Graphon mean-field control for cooperative multi-agent reinforcement learning

Y Hu, X Wei, J Yan, H Zhang - Journal of the Franklin Institute, 2023 - Elsevier
The marriage between mean-field theory and reinforcement learning has shown a great
capacity to solve large-scale control problems with homogeneous agents. To break the …