Reduced-dimensional reinforcement learning control using singular perturbation approximations

S Mukherjee, H Bai, A Chakrabortty - Automatica, 2021 - Elsevier
We present a set of model-free, reduced-dimensional reinforcement learning (RL) based
optimal control designs for linear time-invariant singularly perturbed (SP) systems. We first …

Reinforcement learning of structured stabilizing control for linear systems with unknown state matrix

S Mukherjee, TL Vu - IEEE Transactions on Automatic Control, 2022 - ieeexplore.ieee.org
This article delves into designing stabilizing feedback control gains for continuous-time
linear systems with unknown state matrix, in which the control gain is subjected to a …

Distributed two-time-scale methods over clustered networks

TV Pham, TT Doan, DH Nguyen - 2021 American Control …, 2021 - ieeexplore.ieee.org
In this paper, we consider consensus problems over a network of nodes, where the network
is divided into a number of clusters. We are interested in the case where the communication …

Suboptimal control for nonlinear slow‐fast coupled systems using reinforcement learning and Takagi–Sugeno fuzzy methods

X Liu, C Yang, B Luo, W Dai - International Journal of Adaptive …, 2021 - Wiley Online Library
In this article, by using singular perturbation theory, reinforcement learning (RL), and Takagi–
Sugeno (T‐S) fuzzy methods, a RL‐fuzzy‐based composite suboptimal control method is …

Data-driven pole placement in LMI regions with robustness guarantees

S Mukherjee, RR Hossain - 2022 IEEE 61st Conference on …, 2022 - ieeexplore.ieee.org
This paper proposes a data-driven methodology to place the closed-loop poles in desired
convex regions in the complex plane with sufficient robustness constraints. We considered …

Bridging the Gap Between Reinforcement Learning and Nonlinear Output-Feedback Control

W Gao, ZP Jiang, T Chai - 2024 43rd Chinese Control …, 2024 - ieeexplore.ieee.org
The primary objective of this paper is to bridge the gap between reinforcement learning (RL)
and nonlinear output-feedback control by develo** a novel solution to direct adaptive …

String Stable Platooning Control based on Adaptive Dynamic Programming

W Gao, T Chai, N Qiao, Y Liu - 2024 8th CAA International …, 2024 - ieeexplore.ieee.org
String stability can be employed to evaluate the formation stability of vehicular platoons by
checking if the velocity in the upstream direction of the vehicle platoon decreases, which is …

Reinforcement learning of structured control for linear systems with unknown state matrix

S Mukherjee, TL Vu - arxiv preprint arxiv:2011.01128, 2020 - arxiv.org
This paper delves into designing stabilizing feedback control gains for continuous linear
systems with unknown state matrix, in which the control is subject to a general structural …

On distributed model-free reinforcement learning control with stability guarantee

S Mukherjee, TL Vu - IEEE Control Systems Letters, 2020 - ieeexplore.ieee.org
Distributed learning can enable scalable and effective decision making in numerous
complex cyber-physical systems such as smart transportation, robotics swarm, power …

Model-Free Composite Control for a Class of Semi-Coupled Two-Time-Scale Systems: An Adaptive Dynamic Programming Approach

J Zhao, C Yang, L Zhou, W Gao - IFAC-PapersOnLine, 2021 - Elsevier
This paper proposes a composite control approach for a class of semi-coupled two-time-
scale systems, whose model parameters are completely unknown. In the framework of …