# American Institute of Mathematical Sciences

October  2007, 17(4): 731-738. doi: 10.3934/dcds.2007.17.731

## Stochastic matrix-valued cocycles and non-homogeneous Markov chains

 1 Department of Applied Mathematics, University of Crete, GR-714 09 Heraklion, Crete, Greece

Received  March 2006 Revised  August 2006 Published  January 2007

We prove weak ergodicity theorems for non - homogeneous Markov chains $\{X_\nu\}_{\nu\geq 0}$ taking values in a finite state space $S=\{1,\cdots,n\}$ for which the family of transition matrices $\{g(x)\}_{x\in X}$ is generated from some underlying topological or measurable dynamical system $f:X\to X$. Using the projective metric of Hilbert on $\mathcal{S}=\{(x_1,\cdots,x_n)\in\mathbb R ^n : x_i\geq 0, x_1+\cdots+x_n=1\}$, the space of distributions, we form the skew-product $T:X\times\mathcal{S}\to X\times\mathcal{S}$ defined by $T(x,p)=(f(x),g(x)p)$ and show that, for continuous $g$ positive on some set, weak ergodicity for such processes is a result of the existence of a map $\gamma:X\to\mathcal{S}$ whose graph is attracting and invariant under $T$. Some results on random compositions of non-expansive maps are obtained on the way.
Citation: Demetris Hadjiloucas. Stochastic matrix-valued cocycles and non-homogeneous Markov chains. Discrete and Continuous Dynamical Systems, 2007, 17 (4) : 731-738. doi: 10.3934/dcds.2007.17.731
 [1] Laurent Denis, Anis Matoussi, Jing Zhang. The obstacle problem for quasilinear stochastic PDEs with non-homogeneous operator. Discrete and Continuous Dynamical Systems, 2015, 35 (11) : 5185-5202. doi: 10.3934/dcds.2015.35.5185 [2] Corentin Audiard. On the non-homogeneous boundary value problem for Schrödinger equations. Discrete and Continuous Dynamical Systems, 2013, 33 (9) : 3861-3884. doi: 10.3934/dcds.2013.33.3861 [3] Christine Chambers, Nassif Ghoussoub. Deformation from symmetry and multiplicity of solutions in non-homogeneous problems. Discrete and Continuous Dynamical Systems, 2002, 8 (1) : 267-281. doi: 10.3934/dcds.2002.8.267 [4] Virginia Giorno, Serena Spina. On the return process with refractoriness for a non-homogeneous Ornstein-Uhlenbeck neuronal model. Mathematical Biosciences & Engineering, 2014, 11 (2) : 285-302. doi: 10.3934/mbe.2014.11.285 [5] Franck Boyer, Pierre Fabrie. Outflow boundary conditions for the incompressible non-homogeneous Navier-Stokes equations. Discrete and Continuous Dynamical Systems - B, 2007, 7 (2) : 219-250. doi: 10.3934/dcdsb.2007.7.219 [6] Giuseppe Maria Coclite, Lorenzo di Ruvo. A note on the non-homogeneous initial boundary problem for an Ostrovsky-Hunter type equation. Discrete and Continuous Dynamical Systems - S, 2020, 13 (12) : 3357-3389. doi: 10.3934/dcdss.2020236 [7] María Anguiano, Francisco Javier Suárez-Grau. Newtonian fluid flow in a thin porous medium with non-homogeneous slip boundary conditions. Networks and Heterogeneous Media, 2019, 14 (2) : 289-316. doi: 10.3934/nhm.2019012 [8] Shenghao Li, Min Chen, Bing-Yu Zhang. A non-homogeneous boundary value problem of the sixth order Boussinesq equation in a quarter plane. Discrete and Continuous Dynamical Systems, 2018, 38 (5) : 2505-2525. doi: 10.3934/dcds.2018104 [9] Wojciech M. Zajączkowski. Long time existence of regular solutions to non-homogeneous Navier-Stokes equations. Discrete and Continuous Dynamical Systems - S, 2013, 6 (5) : 1427-1455. doi: 10.3934/dcdss.2013.6.1427 [10] Nassif Ghoussoub. Superposition of selfdual functionals in non-homogeneous boundary value problems and differential systems. Discrete and Continuous Dynamical Systems, 2008, 21 (1) : 187-220. doi: 10.3934/dcds.2008.21.187 [11] Sylvia Novo, Carmen Núñez, Rafael Obaya, Ana M. Sanz. Skew-product semiflows for non-autonomous partial functional differential equations with delay. Discrete and Continuous Dynamical Systems, 2014, 34 (10) : 4291-4321. doi: 10.3934/dcds.2014.34.4291 [12] Alain Miranville, Costică Moroşanu. Analysis of an iterative scheme of fractional steps type associated to the nonlinear phase-field equation with non-homogeneous dynamic boundary conditions. Discrete and Continuous Dynamical Systems - S, 2016, 9 (2) : 537-556. doi: 10.3934/dcdss.2016011 [13] Imam Wijaya, Hirofumi Notsu. Stability estimates and a Lagrange-Galerkin scheme for a Navier-Stokes type model of flow in non-homogeneous porous media. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 1197-1212. doi: 10.3934/dcdss.2020234 [14] Shitao Liu, Roberto Triggiani. Recovering damping and potential coefficients for an inverse non-homogeneous second-order hyperbolic problem via a localized Neumann boundary trace. Discrete and Continuous Dynamical Systems, 2013, 33 (11&12) : 5217-5252. doi: 10.3934/dcds.2013.33.5217 [15] Laura Gambera, Umberto Guarnotta. Strongly singular convective elliptic equations in $\mathbb{R}^N$ driven by a non-homogeneous operator. Communications on Pure and Applied Analysis, , () : -. doi: 10.3934/cpaa.2022088 [16] Jon Aaronson, Michael Bromberg, Nishant Chandgotia. Rational ergodicity of step function skew products. Journal of Modern Dynamics, 2018, 13: 1-42. doi: 10.3934/jmd.2018012 [17] Haritha C, Nikita Agarwal. Product of expansive Markov maps with hole. Discrete and Continuous Dynamical Systems, 2019, 39 (10) : 5743-5774. doi: 10.3934/dcds.2019252 [18] Peng Sun. Measures of intermediate entropies for skew product diffeomorphisms. Discrete and Continuous Dynamical Systems, 2010, 27 (3) : 1219-1231. doi: 10.3934/dcds.2010.27.1219 [19] Felix X.-F. Ye, Yue Wang, Hong Qian. Stochastic dynamics: Markov chains and random transformations. Discrete and Continuous Dynamical Systems - B, 2016, 21 (7) : 2337-2361. doi: 10.3934/dcdsb.2016050 [20] Yakov Pesin. On the work of Sarig on countable Markov chains and thermodynamic formalism. Journal of Modern Dynamics, 2014, 8 (1) : 1-14. doi: 10.3934/jmd.2014.8.1

2020 Impact Factor: 1.392