[BOOK][B] Continuous-time Markov decision processes
X Guo, O Hernández-Lerma, X Guo… - 2009 - Springer
In Chap. 2, we formally introduce the concepts associated to a continuous time MDP.
Namely, the basic model of continuous-time MDPs and the concept of a Markov policy are …
Namely, the basic model of continuous-time MDPs and the concept of a Markov policy are …
[BOOK][B] Markov decision processes with their applications
Q Hu, W Yue - 2007 - books.google.com
Markov decision processes (MDPs), also called stochastic dynamic programming, were first
studied in the 1960s. MDPs can be used to model and solve dynamic decision-making …
studied in the 1960s. MDPs can be used to model and solve dynamic decision-making …
Light in the darkness: new perspective on lanternfish relationships and classification using genomic and morphological data
Massive parallel sequencing allows scientists to gather DNA sequences composed of
millions of base pairs that can be combined into large datasets and analyzed to infer …
millions of base pairs that can be combined into large datasets and analyzed to infer …
[PDF][PDF] Markov decision processes
L Kallenberg - Lecture Notes. University of Leiden, 2011 - researchgate.net
Branching out from operations research roots of the 1950's, Markov decision processes
(MDPs) have gained recognition in such diverse fields as economics, telecommunication …
(MDPs) have gained recognition in such diverse fields as economics, telecommunication …
Optimum maintenance policy using semi-Markov decision processes
CL Tomasevicz, S Asgarpoor - 2006 38th North American …, 2006 - ieeexplore.ieee.org
A method is presented to solve for the optimum maintenance policy of repairable power
equipment. The approach uses a continuous-time semi-Markov process (SMP) to first find …
equipment. The approach uses a continuous-time semi-Markov process (SMP) to first find …
Reinforcement learning in factored mdps: Oracle-efficient algorithms and tighter regret bounds for the non-episodic setting
We study reinforcement learning in non-episodic factored Markov decision processes
(FMDPs). We propose two near-optimal and oracle-efficient algorithms for FMDPs …
(FMDPs). We propose two near-optimal and oracle-efficient algorithms for FMDPs …
Inferring the ancestral sexuality and reproductive condition in sponges (Porifera)
Considerable diversity abounds among sponges with respect to reproductive and
developmental biology. Their ancestral sexual mode (gonochorism vs. hermaphroditism) …
developmental biology. Their ancestral sexual mode (gonochorism vs. hermaphroditism) …
Discounted continuous-time constrained Markov decision processes in Polish spaces
X Guo, X Song - The Annals of Applied Probability, 2011 - JSTOR
This paper is devoted to studying constrained continuous-time Markov decision processes
(MDPs) in the class of randomized policies depending on state histories. The transition rates …
(MDPs) in the class of randomized policies depending on state histories. The transition rates …
A survey of recent results on continuous-time Markov decision processes
This paper is a survey of recent results on continuous-time Markov decision processes
(MDPs) with unbounded transition rates, and reward rates that may be unbounded from …
(MDPs) with unbounded transition rates, and reward rates that may be unbounded from …
Anatomy and evolution of bioluminescent organs in the slimeheads (Teleostei: Trachichthyidae)
Bacterial bioluminescent organs in fishes have a diverse range of tissues of origin, patterns
of compartmentalization, and associated light‐conducting structures. The morphology of the …
of compartmentalization, and associated light‐conducting structures. The morphology of the …