# American Institute of Mathematical Sciences

September & December  2018, 8(3&4): 879-897. doi: 10.3934/mcrf.2018039

## Recurrence for switching diffusion with past dependent switching and countable state space

 1 Department of Mathematics, University of Alabama Tuscaloosa, AL 35401, USA 2 Department of Mathematics, Wayne State University, Detroit. MI 48202, USA

In honor of Jiongmin Yong on the occasion of his 60th Birthday

Received  August 2017 Revised  December 2017 Published  September 2018

Fund Project: This research was supported in part by the Air Force Office of Scientific Research under FA9550-15-1-0131. The research of D. Nguyen was also supported by the AMS-Simons Travel grant.

This work continues and substantially extends our recent work on switching diffusions with the switching processes that depend on the past states and that take values in a countable state space. That is, the discrete component of the two-component process takes values in a countably infinite set and its switching rate at current time depends on the value of the continuous component involving past history. This paper focuses on recurrence, positive recurrence, and weak stabilization of such systems. In particular, the paper aims to providing more verifiable conditions on recurrence and positive recurrence and related issues. Assuming that the system is linearizable, it provides feasible conditions focusing on the coefficients of the systems for positive recurrence. Then linear feedback controls for weak stabilization are considered. Some illustrative examples are also given.

Citation: Dang H. Nguyen, George Yin. Recurrence for switching diffusion with past dependent switching and countable state space. Mathematical Control and Related Fields, 2018, 8 (3&4) : 879-897. doi: 10.3934/mcrf.2018039
##### References:
 [1] W. J. Anderson, Continuous-time Markov chains: An Applications-Oriented Approach, Springer Series in Statistics: Probability and its Applications. Springer-Verlag, New York, 1991. doi: 10.1007/978-1-4612-3038-0. [2] D. Applebaum, Lévy Processes and Stochastic Calculus, Cambridge University Press, 2009. doi: 10.1017/CBO9780511809781. [3] M. F. Chen, From Markov Chains to Non-equilibrium Particle Systems, World Scientific, Singapore, 2004. doi: 10.1142/9789812562456. [4] R. Cont and D.-A. Fournié, Change of variable formulas for non-anticipative functionals on path space, J. Funct. Anal., 259 (2010), 1043-1072.  doi: 10.1016/j.jfa.2010.04.017. [5] R. Cont and D.-A. Fournié, Functional Itô calculus and stochastic integral representation of martingales, Ann. Probab., 41 (2013), 109-133.  doi: 10.1214/11-AOP721. [6] M. Costa, A piecewise deterministic model for a prey-predator community, Ann. Appl. Probab, 26 (2016), 3491-3530.  doi: 10.1214/16-AAP1182. [7] N. T. Dieu, N. H. Du, D. H. Nguyen and G. Yin, Protection zones for survival of species in random environment, SIAM J. Appl. Math., 76 (2016), 1382-1402.  doi: 10.1137/15M1032004. [8] N. T. Dieu, D. H. Nguyen, N. H. Du and G. Yin, Classification of asymptotic behavior in a stochastic SIR model, SIAM J. Appl. Dynamic Sys., 15 (2016), 1062-1084.  doi: 10.1137/15M1043315. [9] N. H. Du and D. H. Nguyen, Dynamics of Kolmogorov systems of competitive type under the telegraph noise, J. Differential Equations, 250 (2011), 386-409.  doi: 10.1016/j.jde.2010.08.023. [10] N. H. Du, D. H. Nguyen and G. Yin, Conditions for permanence and ergodicity of certain stochastic predator-prey models, J. Appl. Probab., 53 (2016), 187-202.  doi: 10.1017/jpr.2015.18. [11] B. Dupire, Functional Itô's Calculus, Bloomberg Portfolio Research Paper No. 2009-04-FRONTIERS Available at SSRN: http://ssrn.com/abstract=1435551 or http://dx.doi.org/10.2139/ssrn.1435551. [12] A. Hening, D. Nguyen and G. Yin, Stochastic population growth in spatially heterogeneous environments: The density-dependent case, J. Math. Biology, 76 (2018), 697-754.  doi: 10.1007/s00285-017-1153-2. [13] S.-B. Hsu, T.-W. Hwang and Y. Kuang, A ratio-dependent food chain model and its applications to biological control, Math. Biosc., 181 (2003), 55-83.  doi: 10.1016/S0025-5564(02)00127-X. [14] R. Z. Khasminskii, C. Zhu and G. Yin, Stability of regime-switching diffusions, Stochastic Process. Appl., 117 (2007), 1037-1051.  doi: 10.1016/j.spa.2006.12.001. [15] V. Kulkarni, Fluid models for single buffer systems, in Frontiers in Queueing: Models and Applications in Science and Engineering, 321–338, Ed. J. H. Dashalalow, CRC Press, 1997. [16] R. F. Luck, Evaluation of natural enemies for biological control: A behavior approach, Trends Ecol. Evol., 5 (1990), 196-199.  doi: 10.1016/0169-5347(90)90210-5. [17] X. Mao, Stochastic Differential Equations and Applications, 2nd Ed., Horwood, Chinester, 2008. doi: 10.1533/9780857099402. [18] X. Mao and C. Yuan. Stochastic Differential Equations with Markovian Switching, Imperial College Press, London, 2006. doi: 10.1142/p473. [19] D. H. Nguyen, N. H. Du and G. Yin, Existence of stationary distributions for Kolmogorov systems of competitive type under telegraph noise, J. Differential Equations, 257 (2014), 2078-2101.  doi: 10.1016/j.jde.2014.05.029. [20] D. H. Nguyen and G. Yin, Modeling and analysis of switching diffusion systems: Past-dependent switching with a countable state space, SIAM J. Control Optim., 54 (2016), 2450-2477.  doi: 10.1137/16M1059357. [21] D. H. Nguyen and G. Yin, Coexistence and exclusion of stochastic competitive Lotka-Volterra models, J. Differential Eqs., 262 (2017), 1192-1225.  doi: 10.1016/j.jde.2016.10.005. [22] D. H. Nguyen and G. Yin, Recurrence and ergodicity of switching diffusions with past-dependent switching having a countable state space, to appear in Potential Anal., (2017). [23] J. Shao, Criteria for transience and recurrence of regime-switching diffusion processes, Electron. J. Probab., 20 (2015), 15 pp. doi: 10.1214/EJP.v20-4018. [24] J. Shao and F. Xi, Strong ergodicity of the regime-switching diffusion processes, Stochastic Process. Appl., 123 (2013), 3903-3918.  doi: 10.1016/j.spa.2013.06.002. [25] J. Shao and F. Xi, Stability and recurrence of regime-switching diffusion processes, SIAM J. Control Optim., 52 (2014), 3496-3516.  doi: 10.1137/140962905. [26] W. M. Wonham, Liapunov criteria for weak stochastic stability, J. Differential Eqs., 2 (1966), 195-207.  doi: 10.1016/0022-0396(66)90043-X. [27] F. Xi and C. Zhu, On Feller and strong Feller properties and exponential ergodicity of regime-switching jump diffusion processes with countable regimes, SIAM J. Control Optim., 55 (2017), 1789-1818.  doi: 10.1137/16M1087837. [28] G. Yin and C. Zhu, Hybrid Switching Diffusions: Properties and Applications, Springer, New York, 2010. doi: 10.1007/978-1-4419-1105-6. [29] G. Yin, H. Q. Zhang and Q. Zhang, Applications of Two-time-scale Markovian Systems, Science Press, Beijing, China, 2013. [30] G. Yin, G. Zhao and F. Wu, Regularization and stabilization of randomly switching dynamic systems, SIAM J. Appl. Math., 72 (2012), 1361-1382.  doi: 10.1137/110851171. [31] J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, Springer-Verlag, New York, NY, 1999. doi: 10.1007/978-1-4612-1466-3. [32] C. Zhu and G. Yin, Asymptotic properties of hybrid diffusion systems, SIAM J. Control Optim., 46 (2007), 1155-1179.  doi: 10.1137/060649343. [33] C. Zhu and G. Yin, On strong Feller, recurrence, and weak stabilization of regime-switching diffusions, SIAM J. Control Optim., 48 (2009), 2003-2031.  doi: 10.1137/080712532. [34] X. Zong, F. Wu, G. Yin and Z. Jin, Almost sure and pth-moment stability and stabilization of regime-switching jump diffusion systems, SIAM J. Control Optim., 52 (2014), 2595-2622.  doi: 10.1137/14095251X.

show all references

In honor of Jiongmin Yong on the occasion of his 60th Birthday

##### References:
 [1] W. J. Anderson, Continuous-time Markov chains: An Applications-Oriented Approach, Springer Series in Statistics: Probability and its Applications. Springer-Verlag, New York, 1991. doi: 10.1007/978-1-4612-3038-0. [2] D. Applebaum, Lévy Processes and Stochastic Calculus, Cambridge University Press, 2009. doi: 10.1017/CBO9780511809781. [3] M. F. Chen, From Markov Chains to Non-equilibrium Particle Systems, World Scientific, Singapore, 2004. doi: 10.1142/9789812562456. [4] R. Cont and D.-A. Fournié, Change of variable formulas for non-anticipative functionals on path space, J. Funct. Anal., 259 (2010), 1043-1072.  doi: 10.1016/j.jfa.2010.04.017. [5] R. Cont and D.-A. Fournié, Functional Itô calculus and stochastic integral representation of martingales, Ann. Probab., 41 (2013), 109-133.  doi: 10.1214/11-AOP721. [6] M. Costa, A piecewise deterministic model for a prey-predator community, Ann. Appl. Probab, 26 (2016), 3491-3530.  doi: 10.1214/16-AAP1182. [7] N. T. Dieu, N. H. Du, D. H. Nguyen and G. Yin, Protection zones for survival of species in random environment, SIAM J. Appl. Math., 76 (2016), 1382-1402.  doi: 10.1137/15M1032004. [8] N. T. Dieu, D. H. Nguyen, N. H. Du and G. Yin, Classification of asymptotic behavior in a stochastic SIR model, SIAM J. Appl. Dynamic Sys., 15 (2016), 1062-1084.  doi: 10.1137/15M1043315. [9] N. H. Du and D. H. Nguyen, Dynamics of Kolmogorov systems of competitive type under the telegraph noise, J. Differential Equations, 250 (2011), 386-409.  doi: 10.1016/j.jde.2010.08.023. [10] N. H. Du, D. H. Nguyen and G. Yin, Conditions for permanence and ergodicity of certain stochastic predator-prey models, J. Appl. Probab., 53 (2016), 187-202.  doi: 10.1017/jpr.2015.18. [11] B. Dupire, Functional Itô's Calculus, Bloomberg Portfolio Research Paper No. 2009-04-FRONTIERS Available at SSRN: http://ssrn.com/abstract=1435551 or http://dx.doi.org/10.2139/ssrn.1435551. [12] A. Hening, D. Nguyen and G. Yin, Stochastic population growth in spatially heterogeneous environments: The density-dependent case, J. Math. Biology, 76 (2018), 697-754.  doi: 10.1007/s00285-017-1153-2. [13] S.-B. Hsu, T.-W. Hwang and Y. Kuang, A ratio-dependent food chain model and its applications to biological control, Math. Biosc., 181 (2003), 55-83.  doi: 10.1016/S0025-5564(02)00127-X. [14] R. Z. Khasminskii, C. Zhu and G. Yin, Stability of regime-switching diffusions, Stochastic Process. Appl., 117 (2007), 1037-1051.  doi: 10.1016/j.spa.2006.12.001. [15] V. Kulkarni, Fluid models for single buffer systems, in Frontiers in Queueing: Models and Applications in Science and Engineering, 321–338, Ed. J. H. Dashalalow, CRC Press, 1997. [16] R. F. Luck, Evaluation of natural enemies for biological control: A behavior approach, Trends Ecol. Evol., 5 (1990), 196-199.  doi: 10.1016/0169-5347(90)90210-5. [17] X. Mao, Stochastic Differential Equations and Applications, 2nd Ed., Horwood, Chinester, 2008. doi: 10.1533/9780857099402. [18] X. Mao and C. Yuan. Stochastic Differential Equations with Markovian Switching, Imperial College Press, London, 2006. doi: 10.1142/p473. [19] D. H. Nguyen, N. H. Du and G. Yin, Existence of stationary distributions for Kolmogorov systems of competitive type under telegraph noise, J. Differential Equations, 257 (2014), 2078-2101.  doi: 10.1016/j.jde.2014.05.029. [20] D. H. Nguyen and G. Yin, Modeling and analysis of switching diffusion systems: Past-dependent switching with a countable state space, SIAM J. Control Optim., 54 (2016), 2450-2477.  doi: 10.1137/16M1059357. [21] D. H. Nguyen and G. Yin, Coexistence and exclusion of stochastic competitive Lotka-Volterra models, J. Differential Eqs., 262 (2017), 1192-1225.  doi: 10.1016/j.jde.2016.10.005. [22] D. H. Nguyen and G. Yin, Recurrence and ergodicity of switching diffusions with past-dependent switching having a countable state space, to appear in Potential Anal., (2017). [23] J. Shao, Criteria for transience and recurrence of regime-switching diffusion processes, Electron. J. Probab., 20 (2015), 15 pp. doi: 10.1214/EJP.v20-4018. [24] J. Shao and F. Xi, Strong ergodicity of the regime-switching diffusion processes, Stochastic Process. Appl., 123 (2013), 3903-3918.  doi: 10.1016/j.spa.2013.06.002. [25] J. Shao and F. Xi, Stability and recurrence of regime-switching diffusion processes, SIAM J. Control Optim., 52 (2014), 3496-3516.  doi: 10.1137/140962905. [26] W. M. Wonham, Liapunov criteria for weak stochastic stability, J. Differential Eqs., 2 (1966), 195-207.  doi: 10.1016/0022-0396(66)90043-X. [27] F. Xi and C. Zhu, On Feller and strong Feller properties and exponential ergodicity of regime-switching jump diffusion processes with countable regimes, SIAM J. Control Optim., 55 (2017), 1789-1818.  doi: 10.1137/16M1087837. [28] G. Yin and C. Zhu, Hybrid Switching Diffusions: Properties and Applications, Springer, New York, 2010. doi: 10.1007/978-1-4419-1105-6. [29] G. Yin, H. Q. Zhang and Q. Zhang, Applications of Two-time-scale Markovian Systems, Science Press, Beijing, China, 2013. [30] G. Yin, G. Zhao and F. Wu, Regularization and stabilization of randomly switching dynamic systems, SIAM J. Appl. Math., 72 (2012), 1361-1382.  doi: 10.1137/110851171. [31] J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, Springer-Verlag, New York, NY, 1999. doi: 10.1007/978-1-4612-1466-3. [32] C. Zhu and G. Yin, Asymptotic properties of hybrid diffusion systems, SIAM J. Control Optim., 46 (2007), 1155-1179.  doi: 10.1137/060649343. [33] C. Zhu and G. Yin, On strong Feller, recurrence, and weak stabilization of regime-switching diffusions, SIAM J. Control Optim., 48 (2009), 2003-2031.  doi: 10.1137/080712532. [34] X. Zong, F. Wu, G. Yin and Z. Jin, Almost sure and pth-moment stability and stabilization of regime-switching jump diffusion systems, SIAM J. Control Optim., 52 (2014), 2595-2622.  doi: 10.1137/14095251X.
 [1] Sebastian Hage-Packhäuser, Michael Dellnitz. Stabilization via symmetry switching in hybrid dynamical systems. Discrete and Continuous Dynamical Systems - B, 2011, 16 (1) : 239-263. doi: 10.3934/dcdsb.2011.16.239 [2] Martin Gugat, Mario Sigalotti. Stars of vibrating strings: Switching boundary feedback stabilization. Networks and Heterogeneous Media, 2010, 5 (2) : 299-314. doi: 10.3934/nhm.2010.5.299 [3] Thomas I. Seidman. Optimal control of a diffusion/reaction/switching system. Evolution Equations and Control Theory, 2013, 2 (4) : 723-731. doi: 10.3934/eect.2013.2.723 [4] Fritz Colonius, Guilherme Mazanti. Decay rates for stabilization of linear continuous-time systems with random switching. Mathematical Control and Related Fields, 2019, 9 (1) : 39-58. doi: 10.3934/mcrf.2019002 [5] Fuke Wu, George Yin, Zhuo Jin. Kolmogorov-type systems with regime-switching jump diffusion perturbations. Discrete and Continuous Dynamical Systems - B, 2016, 21 (7) : 2293-2319. doi: 10.3934/dcdsb.2016048 [6] Caojin Zhang, George Yin, Qing Zhang, Le Yi Wang. Pollution control for switching diffusion models: Approximation methods and numerical results. Discrete and Continuous Dynamical Systems - B, 2019, 24 (8) : 3667-3687. doi: 10.3934/dcdsb.2018310 [7] Zhuo Jin, Linyi Qian. Lookback option pricing for regime-switching jump diffusion models. Mathematical Control and Related Fields, 2015, 5 (2) : 237-258. doi: 10.3934/mcrf.2015.5.237 [8] Jun Li, Fubao Xi. Exponential ergodicity for regime-switching diffusion processes in total variation norm. Discrete and Continuous Dynamical Systems - B, 2022  doi: 10.3934/dcdsb.2021309 [9] A. Settati, A. Lahrouz, Mohamed El Fatini, A. El Haitami, M. El Jarroudi, M. Erriani. A Markovian switching diffusion for an SIS model incorporating Lévy processes. Discrete and Continuous Dynamical Systems - B, 2022  doi: 10.3934/dcdsb.2022072 [10] Wei Xu, Liying Yu, Gui-Hua Lin, Zhi Guo Feng. Optimal switching signal design with a cost on switching action. Journal of Industrial and Management Optimization, 2020, 16 (5) : 2531-2549. doi: 10.3934/jimo.2019068 [11] Zhuo Jin, George Yin, Hailiang Yang. Numerical methods for dividend optimization using regime-switching jump-diffusion models. Mathematical Control and Related Fields, 2011, 1 (1) : 21-40. doi: 10.3934/mcrf.2011.1.21 [12] Guangliang Zhao, Fuke Wu, George Yin. Feedback controls to ensure global solutions and asymptotic stability of Markovian switching diffusion systems. Mathematical Control and Related Fields, 2015, 5 (2) : 359-376. doi: 10.3934/mcrf.2015.5.359 [13] Chao Xu, Yinghui Dong, Zhaolu Tian, Guojing Wang. Pricing dynamic fund protection under a Regime-switching Jump-diffusion model with stochastic protection level. Journal of Industrial and Management Optimization, 2020, 16 (6) : 2603-2623. doi: 10.3934/jimo.2019072 [14] Caibin Zhang, Zhibin Liang, Kam Chuen Yuen. Portfolio optimization for jump-diffusion risky assets with regime switching: A time-consistent approach. Journal of Industrial and Management Optimization, 2022, 18 (1) : 341-366. doi: 10.3934/jimo.2020156 [15] Shuxing Chen, Jianzhong Min, Yongqian Zhang. Weak shock solution in supersonic flow past a wedge. Discrete and Continuous Dynamical Systems, 2009, 23 (1&2) : 115-132. doi: 10.3934/dcds.2009.23.115 [16] Xi Zhu, Changjun Yu, Kok Lay Teo. A new switching time optimization technique for multi-switching systems. Journal of Industrial and Management Optimization, 2022  doi: 10.3934/jimo.2022067 [17] Tomáš Gedeon. Attractors in continuous –time switching networks. Communications on Pure and Applied Analysis, 2003, 2 (2) : 187-209. doi: 10.3934/cpaa.2003.2.187 [18] Xingwu Chen, Weinian Zhang. Normal forms of planar switching systems. Discrete and Continuous Dynamical Systems, 2016, 36 (12) : 6715-6736. doi: 10.3934/dcds.2016092 [19] Niranjan Balachandran, Atreyee Kundu, Debasish Chatterjee. Randomized algorithms for stabilizing switching signals. Mathematical Control and Related Fields, 2019, 9 (1) : 159-174. doi: 10.3934/mcrf.2019009 [20] Dragos-Patru Covei, Elena Cristina Canepa, Traian A. Pirvu. Stochastic production planning with regime switching. Journal of Industrial and Management Optimization, 2022  doi: 10.3934/jimo.2022013

2021 Impact Factor: 1.141