Reinforcement learning for temporal logic control synthesis with probabilistic satisfaction guarantees

M Hasanbeig, Y Kantaros, A Abate… - 2019 IEEE 58th …, 2019 - ieeexplore.ieee.org
We present a model-free reinforcement learning algorithm to synthesize control policies that
maximize the probability of satisfying high-level control objectives given as Linear Temporal …

Optimal control of Markov decision processes with linear temporal logic constraints

X Ding, SL Smith, C Belta, D Rus - IEEE Transactions on …, 2014 - ieeexplore.ieee.org
In this paper, we develop a method to automatically generate a control policy for a
dynamical system modeled as a Markov Decision Process (MDP). The control specification …

Optimality and robustness in multi-robot path planning with temporal logic constraints

A Ulusoy, SL Smith, XC Ding… - … International Journal of …, 2013 - journals.sagepub.com
In this paper we present a method for automatic planning of optimal paths for a group of
robots that satisfy a common high-level mission specification. The motion of each robot is …

Robust control of uncertain Markov decision processes with temporal logic specifications

EM Wolff, U Topcu, RM Murray - 2012 IEEE 51st IEEE …, 2012 - ieeexplore.ieee.org
We present a method for designing a robust control policy for an uncertain system subject to
temporal logic specifications. The system is modeled as a finite Markov Decision Process …

Formal verification and synthesis for discrete-time stochastic systems

M Lahijanian, SB Andersson… - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
Formal methods are increasingly being used for control and verification of dynamic systems
against complex specifications. In general, these methods rely on a relatively simple system …

Learning-based probabilistic LTL motion planning with environment and motion uncertainties

M Cai, H Peng, Z Li, Z Kan - IEEE Transactions on Automatic …, 2020 - ieeexplore.ieee.org
This article considers control synthesis of an autonomous agent with linear temporal logic
(LTL) specifications subject to environment and motion uncertainties. Specifically, the …

Falsification of cyber-physical systems using deep reinforcement learning

T Akazaki, S Liu, Y Yamagata, Y Duan… - … , FM 2018, Held as Part of …, 2018 - Springer
With the rapid development of software and distributed computing, Cyber-Physical Systems
(CPS) are widely adopted in many application areas, eg, smart grid, autonomous …

Least-violating control strategy synthesis with safety rules

J Tumova, GC Hall, S Karaman, E Frazzoli… - Proceedings of the 16th …, 2013 - dl.acm.org
We consider the problem of automatic control strategy synthesis, for discrete models of
robotic systems, to fulfill a task that requires reaching a goal state while obeying a given set …

Probabilistic motion planning under temporal tasks and soft constraints

M Guo, MM Zavlanos - IEEE Transactions on Automatic Control, 2018 - ieeexplore.ieee.org
This paper studies motion planning of a mobile robot under uncertainty. The control
objective is to synthesize a finite-memory control policy, such that a high-level task specified …

Incremental sampling-based algorithm for minimum-violation motion planning

LIR Castro, P Chaudhari, J Tůmová… - … IEEE Conference on …, 2013 - ieeexplore.ieee.org
This paper studies the problem of control strategy synthesis for dynamical systems with
differential constraints to fulfill a given reachability goal while satisfying a set of safety rules …