[BOOK][B] Stopped random walks

A Gut - 2009 - Springer
A random walk is a sequence {Sn, n≥ 0} of random variables with independent, identically
distributed (iid) increments {Xk, k≥ 1} and S0= 0. A Bernoulli random walk (also called a …

SPRT and CUSUM in hidden Markov models

CD Fuh - The Annals of Statistics, 2003 - projecteuclid.org
In this paper, we study the problems of sequential probability ratio tests for parameterized
hidden Markov models. We investigate in some detail the performance of the tests and …

The stationary tail asymptotics in the GI/G/1-type queue with countably many background states

M Miyazawa, YQ Zhao - Advances in Applied Probability, 2004 - cambridge.org
We consider the asymptotic behaviour of the stationary tail probabilities in the discrete-time
GI/G/1-type queue with countable background state space. These probabilities are …

A Markov Renewal Approach to M/G/1 Type Queues with Countably Many Background States

M Miyazawa - Queueing Systems, 2004 - Springer
We consider the stationary distribution of the M/GI/1 type queue when background states are
countable. We are interested in its tail behavior. To this end, we derive a Markov renewal …

Uniform Markov renewal theory and ruin probabilities in Markov random walks

CD Fuh - 2004 - projecteuclid.org
Let X n, n≥ 0 be a Markov chain on a general state space X with transition probability P and
stationary probability π. Suppose an additive component S n takes values in the real line R …

Stability of overshoots of Markov additive processes

L Döring, L Trottner - The Annals of Applied Probability, 2023 - projecteuclid.org
We prove precise stability results for overshoots of Markov additive processes (MAPs) with
finite modulating space. Our approach is based on the Markovian nature of overshoots of …

Quasistochastic matrices and Markov renewal theory

G Alsmeyer - Journal of Applied Probability, 2014 - cambridge.org
Let 𝓈 be a finite or countable set. Given a matrix F=(Fij) i, j∈ 𝓈 of distribution functions on R
and a quasistochastic matrix Q=(qij) i, j∈ 𝓈, ie an irreducible nonnegative matrix with …

Refined distributional limit theorems for compound sums

VK Malinovskii - arxiv preprint arxiv:2404.17155, 2024 - arxiv.org
The paper is a sketch of systematic presentation of distributional limit theorems and their
refinements for compound sums. When analyzing, eg, ergodic semi-Markov systems with …

Asymptotic behavior for Markovian iterated function systems

CD Fuh - Stochastic Processes and their Applications, 2021 - Elsevier
Let (U, d) be a complete separable metric space and (F n) n≥ 0 a sequence of random
functions from U to U. Motivated by studying the stability property for Markovian dynamic …

Local alignment of Markov chains

NR Hansen - 2006 - projecteuclid.org
We consider local alignments without gaps of two independent Markov chains from a finite
alphabet, and we derive sufficient conditions for the number of essentially different local …