What type of inference is planning?

M Lázaro-Gredilla, L Ku, KP Murphy… - Advances in Neural …, 2025 - proceedings.neurips.cc
Multiple types of inference are available for probabilistic graphical models, eg, marginal,
maximum-a-posteriori, and even marginal maximum-a-posteriori. Which one do researchers …

Approximate solutions to constrained risk-sensitive Markov decision processes

UM Kumar, SP Bhat, V Kavitha… - European Journal of …, 2023 - Elsevier
This paper considers the problem of finding near-optimal Markovian randomized (MR)
policies for finite-state-action, infinite-horizon, constrained risk-sensitive Markov decision …

Risk-sensitive reinforcement learning for URLLC traffic in wireless networks

NB Khalifa, M Assaad, M Debbah - 2019 IEEE Wireless …, 2019 - ieeexplore.ieee.org
In this paper, we study the problem of dynamic channel allocation for URLLC traffic in a multi-
user multichannel wireless network where urgent packets have to be successfully received …

Markov decision process design: A framework for integrating strategic and operational decisions

S Brown, S Sinha, AJ Schaefer - Operations Research Letters, 2024 - Elsevier
We consider the problem of optimally designing a system for repeated use under
uncertainty. We develop a modeling framework that integrates the design and operational …

Solving Finite-Horizon MDPs via Low-Rank Tensors

S Rozada, JL Orejuela, AG Marques - arxiv preprint arxiv:2501.10598, 2025 - arxiv.org
We study the problem of learning optimal policies in finite-horizon Markov Decision
Processes (MDPs) using low-rank reinforcement learning (RL) methods. In finite-horizon …

The Symbiosis of Trust and AI: Scientific Foundations for Strategic Network Security, Autonomous Resilience, and Prescriptive Governance

Y Ge - 2024 - search.proquest.com
The rapid development of network systems, driven by innovations like 5G communications,
Industrial 4.0, and Artificial Intelligence (AI)-assisted services, has led to a more complex …

Fixed-point equations solving Risk-sensitive MDP with constraint

V Singh, V Kavitha - 2023 American Control Conference (ACC), 2023 - ieeexplore.ieee.org
There are no computationally feasible algorithms that provide solutions to the finite horizon
Risk-sensitive Con-strained Markov Decision Process (Risk-CMDP) problem, even for …

Optimal Markov Policies for Finite-Horizon Constrained MDPs With Combined Additive And Multiplicative Utilities

UM Kumar, V Kavitha, SP Bhat… - IEEE Control Systems …, 2023 - ieeexplore.ieee.org
This letter considers the problem of optimizing a finite-horizon constrained Markov decision
process (CMDP) where the objective and constraints are sums of additive and multiplicative …

Risk-sensitive reinforcement learning for URLLC traffic in wireless networks

N Ben-Khalifa, M Assaad, M Debbah - arxiv preprint arxiv:1811.02341, 2018 - arxiv.org
In this paper, we study the problem of dynamic channel allocation for URLLC traffic in a multi-
user multi-channel wireless network where urgent packets have to be successfully …

A receding-horizon MDP approach for performance evaluation of moving target defense in networks

Z Qian, J Fu, Q Zhu - 2020 IEEE Conference on Control …, 2020 - ieeexplore.ieee.org
In this paper we study the problem of assessing the effectiveness of a proactive defense-by-
detection policy with a network-based moving target defense. We model the network system …