Heuristically, a discrete-time stochastic process has the Markov property if the past and
future are independent given the present. In this introductory chapter, we give the formal …

Our goal in writing this book has been to provide a comprehensive, mathematically rigorous,
but still accessible treatment of the interaction between information and control in multi …

Power grids, flexible manufacturing, cellular communications: interconnectedness has
consequences. This remarkable book gives the tools and philosophy you need to build …

In many areas of applied mathematics, decentralization of information is a ubiquitous
attribute affecting how to approach a stochastic optimization, decision and estimation, or …

We consider the class of nonlinear optimal control problems (OCPs) with polynomial data,
ie, the differential equation, state and control constraints, and cost are all described by …

We study an expansion of the log likelihood in undirected graphical models such as the
restricted Boltzmann machine (RBM), where each term in the expansion is associated with a …

In this paper, we introduce a general framework for treating channels with memory and
feedback. First, we prove a general feedback channel coding theorem based on Massey's …

This book is about time-homogeneous Markov chains that evolve with discrete time steps on
a countable state space. This theory was born more than 100 years ago, and its beauty …

arxiv:2211.14661v1 [math.PR] 26 Nov 2022 Page 1 Iterated Function Systems: A
Comprehensive Survey Ramen Ghosh ∗ Jakub Mareček † November 29, 2022 Abstract We …

In this paper, we introduce a fundamental principle for optimal communication over general
memoryless channels in the presence of noiseless feedback, termed posterior matching …