Inverse optimization describes a process that is the “reverse” of traditional mathematical
optimization. Unlike traditional optimization, which seeks to compute optimal decisions given …

We provide a tutorial on the construction and evaluation of Markov decision processes
(MDPs), which are powerful analytical tools used for sequential decision making under …

The most appropriate next step in depression treatment after the initial treatment fails is
unclear. This study explores the suitability of the Markov decision process for optimizing …

While chemotherapy is an effective method for treating cancers such as colorectal cancer, its
effectiveness may be dampened by the drug resistance and it may have significant side …

Background: A tantalizing question in medical informatics is how to construct knowledge
from heterogeneous datasets, and as an extension, inform clinical decisions. The …

In recent years, Markov decision processes (MDPs) and partially observable Markov
decision processes (POMDPs) have found important applications to medical decision …

There are disparities in access to livers based on transplant patients' height, which
disproportionately affects Hispanics, Asians, and women (across all ethnicities), because …

There are over 90,000 patients in the United States waiting for a kidney transplant. Under
the current allocation policy, the vast majority of deceased organs are allocated locally. This …

We present a Markov decision process (MDP) model to determine the optimal timing of
blood pressure and cholesterol medications. We study the use of our model for a high-risk …

In the United States, patients with end-stage liver disease must join a waiting list to be
eligible for cadaveric liver transplantation. Due to privacy concerns, the details of the …