# American Institute of Mathematical Sciences

• Previous Article
Online and offline cooperation under buy-online, pick-up-in-store: Pricing and inventory decisions
• JIMO Home
• This Issue
• Next Article
Performance analysis of a discrete-time $Geo/G/1$ retrial queue with non-preemptive priority, working vacations and vacation interruption
July  2019, 15(3): 1447-1453. doi: 10.3934/jimo.2018103

## Probabilistic control of Markov jump systems by scenario optimization approach

 a. School of Textile and Clothing, Key Laboratory of Eco-Textile (Ministry of Education), Jiangnan University, Wuxi 214122, China b. Department of Mathematics and Statistics, Curtin University, GPO Box U1987, Perth WA6845, Australia c. Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Institute of Automation, Jiangnan University, Wuxi 214122, China

* Corresponding author: Yanyan YIN

Received  November 2017 Revised  January 2018 Published  July 2018

Fund Project: The first author is supported by NSFC grant 61503155.

This paper addresses the new problem of probabilistic robust stabilization for uncertain stochastic systems by using scenario optimization approach, where the uncertainties are not assumed to be norm-bounded. State feedback controllers are designed to guarantee that the closed-loop system is robust probabilistic stable. The problem of designing the controller gains is formulated and solved as linear matrix inequality (LMI) constraints. Simulation results are presented to illustrate the correctness and usefulness of the controllers designed.

Citation: Yanqing Liu, Yanyan Yin, Kok Lay Teo, Song Wang, Fei Liu. Probabilistic control of Markov jump systems by scenario optimization approach. Journal of Industrial & Management Optimization, 2019, 15 (3) : 1447-1453. doi: 10.3934/jimo.2018103
##### References:
 [1] S. Boyd, L. E. Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory. Philadelphia, PA: SIAM, vol. 15, Studies in Applied Mathematics, 1994. doi: 10.1137/1.9781611970777.  Google Scholar [2] G. C. Calafiore and M. C. Campi, The scenario approach to robust control design, IEEE Transactions on Automatic Control, 51 (2006), 742-753.  doi: 10.1109/TAC.2006.875041.  Google Scholar [3] B. R. Barmish, New Tools for Robustness of Linear Systems, New York, MacMillan, 1994. Google Scholar [4] G. C. Calafiorea, F. Dabbeneb and R. Tempo, Research on probabilistic methods for control system design, Automatica J. IFAC, 47 (2011), 1279-1293.  doi: 10.1016/j.automatica.2011.02.029.  Google Scholar [5] M. C. Campi, S. Garatti and M. Prandini, The scenario approach for systems and control design, Annual Reviews in Control, 33 (2009), 149-157.   Google Scholar [6] O. L. V. Costa, M. D. Fragoso and R. P. Marques, Discrete-time Markovian Jump Linear Systems, London: Springer-Verlag, 2005. doi: 10.1007/b138575.  Google Scholar [7] Y. Kang, Z. Li, Y. Dong and H. Xi, Markovian based fault-tolerant control for wheeled mobile manipulators, IEEE Trans on Control System Technology, 20 (2012), 266-276.  doi: 10.1109/TCST.2011.2109062.  Google Scholar [8] N. M. Krasovskii and E. A. Lidskii, Analytical design of controllers in systems with random attributes, Automation and Remote Control, 22 (1961), 1141-1146.   Google Scholar [9] A. Nemirovski, Several NP-hard problems arising in robust stability analysis, Mathematics of Control, Signals and Systems, 6 (1993), 99-105.  doi: 10.1007/BF01211741.  Google Scholar [10] A. Prékopa, Stochastic Programming, Norwell, MA: Kluwer, 1995. doi: 10.1007/978-94-017-3087-7.  Google Scholar [11] Y. Shi, Y. Yin, S. Wang, Y. Liu and F. Liu, Distributed leader-following consensus of nonlinear multi-agent systems with nonlinear input dynamics, Neurocomputing, Google Scholar [12] P. Shi, E. K. Boukas and R. Agarwal, Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters, IEEE Trans on Automatic Control, 44 (1999), 1592-1597.  doi: 10.1109/9.780431.  Google Scholar [13] Y. Yin, Z. Lin, Y. Liu and K. L. Teo, Event-triggered constrained control of positive systems with input saturation, International Journal of Robust and Nonlinear Control, 2018. doi: 10.1002/rnc.4097.  Google Scholar [14] Y. Yin and Z. Lin, Constrained control of uncertain nonhomogeneous Markovian jump systems, International Journal of Robust and Nonlinear Control, 27 (2017), 3937-3950.   Google Scholar [15] Y. Yin, Y. Liu, K. L. Teo and S. Wang, Event-triggered probabilistic robust control of linear systems with input constrains: By scenario optimization approach, International Journal of Robust and Nonlinear Control, 28 (2018), 144-153.  doi: 10.1002/rnc.3858.  Google Scholar [16] Y. Yin, P. Shi and F. Liu, Gain-scheduled robust fault detection on time-delay stochastic nonlinear systems, IEEE Trans on Industrial Electronics, 58 (2011), 4908-4916.  doi: 10.1109/TIE.2010.2103537.  Google Scholar [17] Y. Yin, P. Shi, F. Liu, K. L. Teo and C. C. Lim, Robust filtering for nonlinear nonhomogeneous Markov jump systems by fuzzy approximation approach, IEEE Transactions on Cybernetics, 45 (2015), 1706-1716.  doi: 10.1109/TCYB.2014.2358680.  Google Scholar [18] L. Zhu, Y. Yin, F. Liu and S. Wang, $H_∞$ filtering for uncertain periodic Markov jump systems with periodic and partly unknown information, Circuits, Systems, and Signal Processing, (2018), 1-15.  doi: 10.1007/s00034-018-0759-y.  Google Scholar

show all references

##### References:
 [1] S. Boyd, L. E. Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory. Philadelphia, PA: SIAM, vol. 15, Studies in Applied Mathematics, 1994. doi: 10.1137/1.9781611970777.  Google Scholar [2] G. C. Calafiore and M. C. Campi, The scenario approach to robust control design, IEEE Transactions on Automatic Control, 51 (2006), 742-753.  doi: 10.1109/TAC.2006.875041.  Google Scholar [3] B. R. Barmish, New Tools for Robustness of Linear Systems, New York, MacMillan, 1994. Google Scholar [4] G. C. Calafiorea, F. Dabbeneb and R. Tempo, Research on probabilistic methods for control system design, Automatica J. IFAC, 47 (2011), 1279-1293.  doi: 10.1016/j.automatica.2011.02.029.  Google Scholar [5] M. C. Campi, S. Garatti and M. Prandini, The scenario approach for systems and control design, Annual Reviews in Control, 33 (2009), 149-157.   Google Scholar [6] O. L. V. Costa, M. D. Fragoso and R. P. Marques, Discrete-time Markovian Jump Linear Systems, London: Springer-Verlag, 2005. doi: 10.1007/b138575.  Google Scholar [7] Y. Kang, Z. Li, Y. Dong and H. Xi, Markovian based fault-tolerant control for wheeled mobile manipulators, IEEE Trans on Control System Technology, 20 (2012), 266-276.  doi: 10.1109/TCST.2011.2109062.  Google Scholar [8] N. M. Krasovskii and E. A. Lidskii, Analytical design of controllers in systems with random attributes, Automation and Remote Control, 22 (1961), 1141-1146.   Google Scholar [9] A. Nemirovski, Several NP-hard problems arising in robust stability analysis, Mathematics of Control, Signals and Systems, 6 (1993), 99-105.  doi: 10.1007/BF01211741.  Google Scholar [10] A. Prékopa, Stochastic Programming, Norwell, MA: Kluwer, 1995. doi: 10.1007/978-94-017-3087-7.  Google Scholar [11] Y. Shi, Y. Yin, S. Wang, Y. Liu and F. Liu, Distributed leader-following consensus of nonlinear multi-agent systems with nonlinear input dynamics, Neurocomputing, Google Scholar [12] P. Shi, E. K. Boukas and R. Agarwal, Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters, IEEE Trans on Automatic Control, 44 (1999), 1592-1597.  doi: 10.1109/9.780431.  Google Scholar [13] Y. Yin, Z. Lin, Y. Liu and K. L. Teo, Event-triggered constrained control of positive systems with input saturation, International Journal of Robust and Nonlinear Control, 2018. doi: 10.1002/rnc.4097.  Google Scholar [14] Y. Yin and Z. Lin, Constrained control of uncertain nonhomogeneous Markovian jump systems, International Journal of Robust and Nonlinear Control, 27 (2017), 3937-3950.   Google Scholar [15] Y. Yin, Y. Liu, K. L. Teo and S. Wang, Event-triggered probabilistic robust control of linear systems with input constrains: By scenario optimization approach, International Journal of Robust and Nonlinear Control, 28 (2018), 144-153.  doi: 10.1002/rnc.3858.  Google Scholar [16] Y. Yin, P. Shi and F. Liu, Gain-scheduled robust fault detection on time-delay stochastic nonlinear systems, IEEE Trans on Industrial Electronics, 58 (2011), 4908-4916.  doi: 10.1109/TIE.2010.2103537.  Google Scholar [17] Y. Yin, P. Shi, F. Liu, K. L. Teo and C. C. Lim, Robust filtering for nonlinear nonhomogeneous Markov jump systems by fuzzy approximation approach, IEEE Transactions on Cybernetics, 45 (2015), 1706-1716.  doi: 10.1109/TCYB.2014.2358680.  Google Scholar [18] L. Zhu, Y. Yin, F. Liu and S. Wang, $H_∞$ filtering for uncertain periodic Markov jump systems with periodic and partly unknown information, Circuits, Systems, and Signal Processing, (2018), 1-15.  doi: 10.1007/s00034-018-0759-y.  Google Scholar
State trajectory of a-posteriori Monte-Carlo analysis
 [1] Ardeshir Ahmadi, Hamed Davari-Ardakani. A multistage stochastic programming framework for cardinality constrained portfolio optimization. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 359-377. doi: 10.3934/naco.2017023 [2] Longxiang Fang, Narayanaswamy Balakrishnan, Wenyu Huang. Stochastic comparisons of parallel systems with scale proportional hazards components equipped with starting devices. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2021004 [3] Ademir Fernando Pazoto, Lionel Rosier. Uniform stabilization in weighted Sobolev spaces for the KdV equation posed on the half-line. Discrete & Continuous Dynamical Systems - B, 2010, 14 (4) : 1511-1535. doi: 10.3934/dcdsb.2010.14.1511 [4] Luke Finlay, Vladimir Gaitsgory, Ivan Lebedev. Linear programming solutions of periodic optimization problems: approximation of the optimal control. Journal of Industrial & Management Optimization, 2007, 3 (2) : 399-413. doi: 10.3934/jimo.2007.3.399 [5] Wenmin Gong, Guangcun Lu. On coupled Dirac systems. Discrete & Continuous Dynamical Systems - A, 2017, 37 (8) : 4329-4346. doi: 10.3934/dcds.2017185 [6] Hong Seng Sim, Wah June Leong, Chuei Yee Chen, Siti Nur Iqmal Ibrahim. Multi-step spectral gradient methods with modified weak secant relation for large scale unconstrained optimization. Numerical Algebra, Control & Optimization, 2018, 8 (3) : 377-387. doi: 10.3934/naco.2018024 [7] J. Frédéric Bonnans, Justina Gianatti, Francisco J. Silva. On the convergence of the Sakawa-Shindo algorithm in stochastic control. Mathematical Control & Related Fields, 2016, 6 (3) : 391-406. doi: 10.3934/mcrf.2016008 [8] Diana Keller. Optimal control of a linear stochastic Schrödinger equation. Conference Publications, 2013, 2013 (special) : 437-446. doi: 10.3934/proc.2013.2013.437 [9] Seung-Yeal Ha, Dongnam Ko, Chanho Min, Xiongtao Zhang. Emergent collective behaviors of stochastic kuramoto oscillators. Discrete & Continuous Dynamical Systems - B, 2020, 25 (3) : 1059-1081. doi: 10.3934/dcdsb.2019208 [10] María J. Garrido-Atienza, Bohdan Maslowski, Jana  Šnupárková. Semilinear stochastic equations with bilinear fractional noise. Discrete & Continuous Dynamical Systems - B, 2016, 21 (9) : 3075-3094. doi: 10.3934/dcdsb.2016088 [11] Haiyan Wang. Existence and nonexistence of positive radial solutions for quasilinear systems. Conference Publications, 2009, 2009 (Special) : 810-817. doi: 10.3934/proc.2009.2009.810 [12] Tuvi Etzion, Alexander Vardy. On $q$-analogs of Steiner systems and covering designs. Advances in Mathematics of Communications, 2011, 5 (2) : 161-176. doi: 10.3934/amc.2011.5.161 [13] Alberto Bressan, Ke Han, Franco Rampazzo. On the control of non holonomic systems by active constraints. Discrete & Continuous Dynamical Systems - A, 2013, 33 (8) : 3329-3353. doi: 10.3934/dcds.2013.33.3329 [14] Lekbir Afraites, Abdelghafour Atlas, Fahd Karami, Driss Meskine. Some class of parabolic systems applied to image processing. Discrete & Continuous Dynamical Systems - B, 2016, 21 (6) : 1671-1687. doi: 10.3934/dcdsb.2016017 [15] Graziano Crasta, Philippe G. LeFloch. Existence result for a class of nonconservative and nonstrictly hyperbolic systems. Communications on Pure & Applied Analysis, 2002, 1 (4) : 513-530. doi: 10.3934/cpaa.2002.1.513 [16] Nhu N. Nguyen, George Yin. Stochastic partial differential equation models for spatially dependent predator-prey equations. Discrete & Continuous Dynamical Systems - B, 2020, 25 (1) : 117-139. doi: 10.3934/dcdsb.2019175 [17] Bin Pei, Yong Xu, Yuzhen Bai. Convergence of p-th mean in an averaging principle for stochastic partial differential equations driven by fractional Brownian motion. Discrete & Continuous Dynamical Systems - B, 2020, 25 (3) : 1141-1158. doi: 10.3934/dcdsb.2019213 [18] Shihu Li, Wei Liu, Yingchao Xie. Large deviations for stochastic 3D Leray-$\alpha$ model with fractional dissipation. Communications on Pure & Applied Analysis, 2019, 18 (5) : 2491-2509. doi: 10.3934/cpaa.2019113 [19] Shanjian Tang, Fu Zhang. Path-dependent optimal stochastic control and viscosity solution of associated Bellman equations. Discrete & Continuous Dynamical Systems - A, 2015, 35 (11) : 5521-5553. doi: 10.3934/dcds.2015.35.5521 [20] F.J. Herranz, J. de Lucas, C. Sardón. Jacobi--Lie systems: Fundamentals and low-dimensional classification. Conference Publications, 2015, 2015 (special) : 605-614. doi: 10.3934/proc.2015.0605

2019 Impact Factor: 1.366