Vsevolod Shneer (School of Mathematical and Computer Sciences, Heriot-Watt University)

Stability of Markov-modulated Markov chains
Wednesday 30 November 2011 at 15.30, JCMB 6206

Abstract

We consider a discrete-time Markov chain (Xn, Yn), where the X-component forms a Markov chain itself. Assuming that (Xn) is ergodic, we formulate the following "naive" conjecture. Consider an auxiliary Markov chain whose transition probabilities are the averages of transition probabilities of the Y-component of the (X, Y)-chain, where the averaging is weighted by the stationary distribution of the X-component. The conjecture is: if the this chain is positive recurrent, then so is the (X, Y)-chain. We first show that, under appropriate technical assumptions, such a general result indeed holds, and then apply it to two versions of a multi-access wireless model governed by two randomised protocols.

Seminars by year

Current 2011 2010 2009 2008 2007 2006 2005 2004 2003 2002 2001 2000 1999 1998 1997 1996