Adaptive dynamic programming for control: A survey and recent advances

D Liu, S Xue, B Zhao, B Luo… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This article reviews the recent development of adaptive dynamic programming (ADP) with
applications in control. First, its applications in optimal regulation are introduced, and some …

Learning-based control: A tutorial and some recent results

ZP Jiang, T Bian, W Gao - Foundations and Trends® in …, 2020 - nowpublishers.com
This monograph presents a new framework for learning-based control synthesis of
continuous-time dynamical systems with unknown dynamics. The new design paradigm …

Model-Free λ-Policy Iteration for Discrete-Time Linear Quadratic Regulation

Y Yang, B Kiumarsi, H Modares… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
This article presents a model-free-policy iteration (-PI) for the discrete-time linear quadratic
regulation (LQR) problem. To solve the algebraic Riccati equation arising from solving the …

Barrier Lyapunov functions for Nussbaum gain adaptive control of full state constrained nonlinear systems

YJ Liu, S Tong - Automatica, 2017 - Elsevier
In this paper, an adaptive controller design is studied for single-input–single-output (SISO)
nonlinear systems with parameter uncertainties and the systems are enforced to subject to …

NN reinforcement learning adaptive control for a class of nonstrict-feedback discrete-time systems

W Bai, T Li, S Tong - IEEE Transactions on Cybernetics, 2020 - ieeexplore.ieee.org
This article investigates an adaptive reinforcement learning (RL) optimal control design
problem for a class of nonstrict-feedback discrete-time systems. Based on the neural …

Adaptive critic nonlinear robust control: A survey

D Wang, H He, D Liu - IEEE transactions on cybernetics, 2017 - ieeexplore.ieee.org
Adaptive dynamic programming (ADP) and reinforcement learning are quite relevant to each
other when performing intelligent optimization. They are both regarded as promising …

Tracking Control of Completely Unknown Continuous-Time Systems via Off-Policy Reinforcement Learning

H Modares, FL Lewis, ZP Jiang - IEEE transactions on neural …, 2015 - ieeexplore.ieee.org
This paper deals with the design of an H∞ tracking controller for nonlinear continuous-time
systems with completely unknown dynamics. A general bounded L 2-gain tracking problem …

Model-free optimal tracking control via critic-only Q-learning

B Luo, D Liu, T Huang, D Wang - IEEE transactions on neural …, 2016 - ieeexplore.ieee.org
Model-free control is an important and promising topic in control fields, which has attracted
extensive attention in the past few years. In this paper, we aim to solve the model-free …

H∞ control of linear discrete-time systems: Off-policy reinforcement learning

B Kiumarsi, FL Lewis, ZP Jiang - Automatica, 2017 - Elsevier
In this paper, a model-free solution to the H∞ control of linear discrete-time systems is
presented. The proposed approach employs off-policy reinforcement learning (RL) to solve …

Adaptive controller design-based ABLF for a class of nonlinear time-varying state constraint systems

YJ Liu, S Lu, D Li, S Tong - IEEE Transactions on Systems …, 2016 - ieeexplore.ieee.org
In this paper, we address an adaptive control problem for a class of nonlinear strict-feedback
systems with uncertain parameter. The full states of the systems are constrained in the …