This report reviews the conceptual and theoretical links between Granger causality and
directed information theory. We begin with a short historical tour of Granger causality …

Theory of mind (ToM) is the psychological construct by which we model another's internal
mental states. Through ToM, we adjust our own behaviour to best suit a social context, and …

Predicting human behavior from a small amount of training examples is a challenging
machine learning problem. In this thesis, we introduce the principle of maximum causal …

There is an increasing interest in studying control systems employing multiple sensors and
actuators that are geographically distributed. Communication is an important component of …

This book is an evolution from my book A First Course in Information Theory published in
2002 when network coding was still at its infancy. The last few years have witnessed the …

The principle of maximum entropy provides a powerful framework for statistical models of
joint, conditional, and marginal distributions. However, there are many important …

Transfer entropy (TE) is an information-theoretic measure which has received recent
attention in neuroscience for its potential to identify effective connectivity between neurons …

Advances in recording technologies have given neuroscience researchers access to large
amounts of data, in particular, simultaneous, individual recordings of large groups of …

Consider a control problem with a communication channel connecting the observer of a
linear stochastic system to the controller. The goal of the controller is to minimize a quadratic …

The problems of causality, modeling, and control for chaotic, high-dimensional dynamical
systems are formulated in the language of information theory. The central quantity of interest …