Far Eastern Mathematical Journal

To content of the issue

Stochastic control of discrete Markov process parameter

G. Sh. Tsitsiashvili, M. A. Osipova

2002, issue 1, P. 58–60

Abstract

Consider a functioning of discrete Markov process in random environment. That is the process behavior is defined by some randomly varying parameter. Suppose that stationary distributions of the process under fixed meanings of the parameter are known. A problem is to choose rules of parameter ramdom variation so that the stationary distribution of obtained process equals to probability mixture of stationary distributions of this process under fixed parameter meanings. Traditional product theorem gives a respond to this question only if stationary distributions, which correspond to the fixed parameter meanings, coincide with each other. In this paper new and sufficiently simple condition on random parameter variation is introduced. This condition gives a solution of considered problem in general case.

Keywords:

Download the article (PDF-file)

References

[1] F. P. Kelly, Reversibility and Stochastic Networks, John Wiley & Sons, 1979. [2] Y. Zhu, “Markovian Queueing Networks in Random Environment”, Operations Research Letters, 15 (1994), 11–17. [3] D. Baum, G. Sh. Tsitsiashvili, “On Product Connection Theorems for Markov Chains”, Int. J. Pure Appl. Math., 1:2 (2002), 167–196. [4] M. A. Osipova, G. Sh. Ciciashvili, N. V. Kol'ev, “Vychislenie stacionarnogo raspredeleniya v adaptivnyx setyax massovogo obsluzhivaniya”, Dal'nevost. matem. Zhurn., 2:2 (2001), 99–105.

To content of the issue