We introduce the sensor-utility-network (SUN) method for occupancy estimation in buildings.
Based on inputs from a variety of sensor measurements, along with historical data regarding …

Agent-based modelling (ABM) simulates Social-Ecological-Systems (SESs) based on the
decision-making and actions of individual actors or actor groups, their interactions with each …

Infrastructure security against possible attacks involves making decisions under uncertainty.
This paper presents game theoretic models of the interaction between an adversary and a …

This paper is concerned with model reduction for complex Markov chain models. The
Kullback-Leibler divergence rate is employed as a metric to measure the difference between …

In this article, we propose a fast reinforcement learning (RL) control algorithm that enables
online control of large-scale networked dynamic systems. RL is an effective way of …

This paper is concerned with an information-theoretic framework to aggregate a large-scale
Markov chain to obtain a reduced order Markov model. The Kullback-Leibler (KL) …

Abstract Model reduction of large Markov chains is an essential step in a wide array of
techniques for understanding complex systems and for efficiently learning structures from …

Model reduction methods from diverse fields-including control, statistical mechanics and
economics-aimed at systems that can be represented by Markov chains, are discussed in …

This paper is concerned with modeling, analysis and optimization/control of occupancy
evolution in a large building. The main concern is efficient evacuation of a building in the …

This paper addresses model reduction for a Markov chain on a large state space. A
simulation-based framework is introduced to perform state aggregation of the Markov chain …