Computation of Invariant Measures and Stationary Expectations for Markov Chains with Block-Band Transition Matrix
This paper deals with the computation of invariant measures and stationary expectations for discrete-time Markov chains governed by a block-structured one-step transition probability matrix. The method generalizes in some respect Neuts’ matrix-geometric approach to vector-state Markov chains. The me...
Main Authors: | Hendrik Baumann, Thomas Hanschke |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2020-01-01
|
Series: | Journal of Applied Mathematics |
Online Access: | http://dx.doi.org/10.1155/2020/4318906 |
Similar Items
-
Computing Hitting Probabilities of Markov Chains: Structural Results with regard to the Solution Space of the Corresponding System of Equations
by: Hendrik Baumann, et al.
Published: (2020-01-01) -
Computation of solutions to linear difference and differential equations with a prescribed asymptotic behavior
by: Hendrik Baumann, et al.
Published: (2021-03-01) -
Estimation of the stationary distribution of Markov chains
by: Garibotti, Gilda
Published: (2004) -
The Expectation of Transition Events on Finite-state Markov Chains
by: West, Jeremy Michael
Published: (2009) -
Estimation of the stationary distribution of a semi-Markov chain
by: Barbu, Vlad, et al.
Published: (2012)