Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems

Previous Article
Analysis of the Newsboy Problem subject to price dependent demand and multiple discounts
JIMO Home
This Issue
Next Article
On optimality conditions and duality for non-differentiable interval-valued programming problems with the generalized (F, ρ)-convexity

July 2018, 14(3): 913-930. doi: 10.3934/jimo.2017082

Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems

Yuefen Chen ^1, and Yuanguo Zhu ^2,,

1.	School of Mathematics and Statistics, Xinyang Normal University, Xinyang, Henan 464000, China
2.	School of Science, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China

* Corresponding author: ygzhu@njust.edu.cn

Received February 2016 Revised August 2017 Published July 2018 Early access September 2017

Fund Project: This work is supported by the National Natural Science Foundation of China (No.61673011), the Nanhu Scholars Program for Young Scholars of XYNU and the Key Scientific Research Project for Colleges and Universities of Henan Province (No.17A120013).

Uncertainty theory is a branch of axiomatic mathematics that deals with human uncertainty. Based on uncertainty theory, this paper discusses linear quadratic (LQ) optimal control with process state inequality constraints for discrete-time uncertain systems, where the weighting matrices in the cost function are assumed to be indefinite. By means of the maximum principle with mixed inequality constraints, we present a necessary condition for the existence of optimal state feedback control that involves a constrained difference equation. Moreover, the existence of a solution to the constrained difference equation is equivalent to the solvability of the indefinite LQ problem. Furthermore, the well-posedness of the indefinite LQ problem is proved. Finally, an example is provided to demonstrate the effectiveness of our theoretical results.

Keywords: Indefinite LQ control, process state inequality constraints, discrete-time uncertain systems, constrained difference equation.

Mathematics Subject Classification: Primary: 49N10, 49L20; Secondary: 65K05.

Citation: Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial and Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082

References:

[1]	M. Athans, The matrix minimum principle, Information and Control, 11 (1967), 592-606. doi: 10.1016/S0019-9958(67)90803-0.
[2]	K. Bahlali, B. Djehiche and B. Mezerdi, On the stochastic maximum principle in optimal control of degenerate diffusions with Lipschitz coefficients, Applied Mathematics and Optimization, 56 (2007), 364-378. doi: 10.1007/s00245-007-9017-6.
[3]	A. Bensoussan, S. P. Sethi, R. G. Vickson and N. Derzko, Stochastic production planning with production constraints: A summary, SIAM Journal on Control and Optimization, 22 (1984), 920-935. doi: 10.1137/0322060.
[4]	D. P. Bertsekas, Dynamic Programming and Stochastic Control, Mathematics in Science and Engineering, 125. Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1976.
[5]	S. P. Chen, X. J. Li and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Control and Optimization, 36 (1998), 1685-1702. doi: 10.1137/S0363012996310478.
[6]	X. Chen, Y. Liu and D. A. Ralescu, Uncertain stock model with periodic dividends, Fuzzy Optimization and Decision Making, 12 (2013), 111-123. doi: 10.1007/s10700-012-9141-x.
[7]	Y. Gao, Uncertain models for single facility location problems on networks, Applied Mathematical Modelling, 36 (2012), 2592-2599. doi: 10.1016/j.apm.2011.09.042.
[8]	M. R. Hestenes, Calculus of Variations and Optimal Control Theory Wiley, New York, 1966.
[9]	Y. Hu and X. Y. Zhou, Constrained stochastic LQ control with random coefficients, and application to portfolio selection, SIAM Journal on Control and Optimization, 44 (2005), 444-466. doi: 10.1137/S0363012904441969.
[10]	D. Kahneman and A. Tversky, Prospect theory: an analysis of decision under risk, Econometrica, 47 (1979), 263-292.
[11]	X. Li and X. Y. Zhou, Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon, Communications on Information and Systems, 2 (2002), 265-282. doi: 10.4310/CIS.2002.v2.n3.a4.
[12]	B. Liu, Uncertainty Theory 2^nd edition, Springer-Verlag, Berlin, 2004. doi: 10.1007/978-3-540-39987-2.
[13]	B. Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty Springer-Verlag, Heidelberg, 2015. doi: 10.1007/978-3-662-44354-5.
[14]	B. Liu, Some research problems in uncertainty theory, Journal of Uncertain Systems, 3 (2009), 3-10.
[15]	X. Liu, Y. Li and W. Zhang, Stochastic linear quadratic optimal control with constraint for discrete-time systems, Applied Mathematics and Computation, 228 (2014), 264-270. doi: 10.1016/j.amc.2013.09.036.
[16]	B. Liu and K. Yao, Uncertain multilevel programming: Algorithm and applications, Computers and Industrial Engineering, 89 (2014), 235-240. doi: 10.1016/j.cie.2014.09.029.
[17]	R. Penrose, A generalized inverse of matrices, Mathematical Proceedings of the Cambridge Philosophical Society, 51 (1955), 406-413. doi: 10.1017/S0305004100030401.
[18]	L. Sheng and Y. Zhu, Optimistic value model of uncertain optimal control, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 21 (2013), 75-87. doi: 10.1142/S0218488513400060.
[19]	Y. Shu and Y. Zhu, Stability and optimal control for uncertain continuous-time singular systems, European Journal of Control, 34 (2017), 16-23. doi: 10.1016/j.ejcon.2016.12.003.
[20]	V. K. Socgnia and O. Menoukeu-Pamen, An infinite horizon stochastic maximum principle for discounted control problem with Lipschitz coefficients, Journal of Mathematical Analysis and Applications, 422 (2015), 684-711. doi: 10.1016/j.jmaa.2014.09.010.
[21]	Z. Wang, J. Guo, M. Zheng and Y. Yang, A new approach for uncertain multiobjective programming problem based on $\mathcal{P}_E$ principle, Journal of Industrial and Management Optimization, 11 (2015), 13-26. doi: 10.3934/jimo.2015.11.13.
[22]	W. M. Wonham, On a matrix Riccati equation of stochastic control, SIAM Journal on Control and Optimization, 6 (1968), 681-697. doi: 10.1137/0306044.
[23]	H. Yan, Y. Sun and Y. Zhu, A linear-quadratic control problem of uncertain discrete-time switched systems, Journal of Industrial and Management Optimization, 13 (2017), 267-282. doi: 10.3934/jimo.2016016.
[24]	J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations Springer, New York, 1999. doi: 10.1007/978-1-4612-1466-3.
[25]	W. Zhang, H. Zhang and B. S. Chen, Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion, IEEE Transactions on Automatic Control, 53 (2008), 1630-1642. doi: 10.1109/TAC.2008.929368.
[26]	W. Zhang and B. S. Chen, On stabilizability and exact observability of stochastic systems with their applications, Automatica, 40 (2004), 87-94. doi: 10.1016/j.automatica.2003.07.002.
[27]	W. Zhang and G. Li, Discrete-time indefinite stochastic linear quadratic optimal control with second moment constraints Mathematical Problems in Engineering 2014 (2014), Art. ID 278142, 9 pp. doi: 10.1155/2014/278142.
[28]	X. Y. Zhou and D. Li, Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization, 42 (2000), 19-33. doi: 10.1007/s002450010003.
[29]	Y. Zhu, Uncertain optimal control with application to a portfolio selection model, Cybernetics and Systems: An International Journal, 41 (2010), 535-547. doi: 10.1080/01969722.2010.511552.
[30]	Y. Zhu, Functions of uncertain variables and uncertain programming, Journal of Uncertain Systems, 6 (2012), 278-288.

show all references

References:

[1]	M. Athans, The matrix minimum principle, Information and Control, 11 (1967), 592-606. doi: 10.1016/S0019-9958(67)90803-0.
[2]	K. Bahlali, B. Djehiche and B. Mezerdi, On the stochastic maximum principle in optimal control of degenerate diffusions with Lipschitz coefficients, Applied Mathematics and Optimization, 56 (2007), 364-378. doi: 10.1007/s00245-007-9017-6.
[3]	A. Bensoussan, S. P. Sethi, R. G. Vickson and N. Derzko, Stochastic production planning with production constraints: A summary, SIAM Journal on Control and Optimization, 22 (1984), 920-935. doi: 10.1137/0322060.
[4]	D. P. Bertsekas, Dynamic Programming and Stochastic Control, Mathematics in Science and Engineering, 125. Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1976.
[5]	S. P. Chen, X. J. Li and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Control and Optimization, 36 (1998), 1685-1702. doi: 10.1137/S0363012996310478.
[6]	X. Chen, Y. Liu and D. A. Ralescu, Uncertain stock model with periodic dividends, Fuzzy Optimization and Decision Making, 12 (2013), 111-123. doi: 10.1007/s10700-012-9141-x.
[7]	Y. Gao, Uncertain models for single facility location problems on networks, Applied Mathematical Modelling, 36 (2012), 2592-2599. doi: 10.1016/j.apm.2011.09.042.
[8]	M. R. Hestenes, Calculus of Variations and Optimal Control Theory Wiley, New York, 1966.
[9]	Y. Hu and X. Y. Zhou, Constrained stochastic LQ control with random coefficients, and application to portfolio selection, SIAM Journal on Control and Optimization, 44 (2005), 444-466. doi: 10.1137/S0363012904441969.
[10]	D. Kahneman and A. Tversky, Prospect theory: an analysis of decision under risk, Econometrica, 47 (1979), 263-292.
[11]	X. Li and X. Y. Zhou, Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon, Communications on Information and Systems, 2 (2002), 265-282. doi: 10.4310/CIS.2002.v2.n3.a4.
[12]	B. Liu, Uncertainty Theory 2^nd edition, Springer-Verlag, Berlin, 2004. doi: 10.1007/978-3-540-39987-2.
[13]	B. Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty Springer-Verlag, Heidelberg, 2015. doi: 10.1007/978-3-662-44354-5.
[14]	B. Liu, Some research problems in uncertainty theory, Journal of Uncertain Systems, 3 (2009), 3-10.
[15]	X. Liu, Y. Li and W. Zhang, Stochastic linear quadratic optimal control with constraint for discrete-time systems, Applied Mathematics and Computation, 228 (2014), 264-270. doi: 10.1016/j.amc.2013.09.036.
[16]	B. Liu and K. Yao, Uncertain multilevel programming: Algorithm and applications, Computers and Industrial Engineering, 89 (2014), 235-240. doi: 10.1016/j.cie.2014.09.029.
[17]	R. Penrose, A generalized inverse of matrices, Mathematical Proceedings of the Cambridge Philosophical Society, 51 (1955), 406-413. doi: 10.1017/S0305004100030401.
[18]	L. Sheng and Y. Zhu, Optimistic value model of uncertain optimal control, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 21 (2013), 75-87. doi: 10.1142/S0218488513400060.
[19]	Y. Shu and Y. Zhu, Stability and optimal control for uncertain continuous-time singular systems, European Journal of Control, 34 (2017), 16-23. doi: 10.1016/j.ejcon.2016.12.003.
[20]	V. K. Socgnia and O. Menoukeu-Pamen, An infinite horizon stochastic maximum principle for discounted control problem with Lipschitz coefficients, Journal of Mathematical Analysis and Applications, 422 (2015), 684-711. doi: 10.1016/j.jmaa.2014.09.010.
[21]	Z. Wang, J. Guo, M. Zheng and Y. Yang, A new approach for uncertain multiobjective programming problem based on $\mathcal{P}_E$ principle, Journal of Industrial and Management Optimization, 11 (2015), 13-26. doi: 10.3934/jimo.2015.11.13.
[22]	W. M. Wonham, On a matrix Riccati equation of stochastic control, SIAM Journal on Control and Optimization, 6 (1968), 681-697. doi: 10.1137/0306044.
[23]	H. Yan, Y. Sun and Y. Zhu, A linear-quadratic control problem of uncertain discrete-time switched systems, Journal of Industrial and Management Optimization, 13 (2017), 267-282. doi: 10.3934/jimo.2016016.
[24]	J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations Springer, New York, 1999. doi: 10.1007/978-1-4612-1466-3.
[25]	W. Zhang, H. Zhang and B. S. Chen, Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion, IEEE Transactions on Automatic Control, 53 (2008), 1630-1642. doi: 10.1109/TAC.2008.929368.
[26]	W. Zhang and B. S. Chen, On stabilizability and exact observability of stochastic systems with their applications, Automatica, 40 (2004), 87-94. doi: 10.1016/j.automatica.2003.07.002.
[27]	W. Zhang and G. Li, Discrete-time indefinite stochastic linear quadratic optimal control with second moment constraints Mathematical Problems in Engineering 2014 (2014), Art. ID 278142, 9 pp. doi: 10.1155/2014/278142.
[28]	X. Y. Zhou and D. Li, Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization, 42 (2000), 19-33. doi: 10.1007/s002450010003.
[29]	Y. Zhu, Uncertain optimal control with application to a portfolio selection model, Cybernetics and Systems: An International Journal, 41 (2010), 535-547. doi: 10.1080/01969722.2010.511552.
[30]	Y. Zhu, Functions of uncertain variables and uncertain programming, Journal of Uncertain Systems, 6 (2012), 278-288.

[1]	Elena K. Kostousova. On polyhedral control synthesis for dynamical discrete-time systems under uncertainties and state constraints. Discrete and Continuous Dynamical Systems, 2018, 38 (12) : 6149-6162. doi: 10.3934/dcds.2018153
[2]	Hongyan Yan, Yun Sun, Yuanguo Zhu. A linear-quadratic control problem of uncertain discrete-time switched systems. Journal of Industrial and Management Optimization, 2017, 13 (1) : 267-282. doi: 10.3934/jimo.2016016
[3]	Elena K. Kostousova. On control synthesis for uncertain dynamical discrete-time systems through polyhedral techniques. Conference Publications, 2015, 2015 (special) : 723-732. doi: 10.3934/proc.2015.0723
[4]	Martino Bardi, Shigeaki Koike, Pierpaolo Soravia. Pursuit-evasion games with state constraints: dynamic programming and discrete-time approximations. Discrete and Continuous Dynamical Systems, 2000, 6 (2) : 361-380. doi: 10.3934/dcds.2000.6.361
[5]	Xi Zhu, Meixia Li, Chunfa Li. Consensus in discrete-time multi-agent systems with uncertain topologies and random delays governed by a Markov chain. Discrete and Continuous Dynamical Systems - B, 2020, 25 (12) : 4535-4551. doi: 10.3934/dcdsb.2020111
[6]	Haijun Sun, Xinquan Zhang. Guaranteed cost control of discrete-time switched saturated systems. Discrete and Continuous Dynamical Systems - B, 2021, 26 (8) : 4515-4522. doi: 10.3934/dcdsb.2020300
[7]	Guangjun Shen, Xueying Wu, Xiuwei Yin. Stabilization of stochastic differential equations driven by G-Lévy process with discrete-time feedback control. Discrete and Continuous Dynamical Systems - B, 2021, 26 (2) : 755-774. doi: 10.3934/dcdsb.2020133
[8]	Lixuan Zhang, Xuefei Yang. On pole assignment of high-order discrete-time linear systems with multiple state and input delays. Discrete and Continuous Dynamical Systems - S, 2022 doi: 10.3934/dcdss.2022022
[9]	Aleksandar Zatezalo, Dušan M. Stipanović. Control of dynamical systems with discrete and uncertain observations. Discrete and Continuous Dynamical Systems, 2015, 35 (9) : 4665-4681. doi: 10.3934/dcds.2015.35.4665
[10]	Chuandong Li, Fali Ma, Tingwen Huang. 2-D analysis based iterative learning control for linear discrete-time systems with time delay. Journal of Industrial and Management Optimization, 2011, 7 (1) : 175-181. doi: 10.3934/jimo.2011.7.175
[11]	Ran Dong, Xuerong Mao. Asymptotic stabilization of continuous-time periodic stochastic systems by feedback control based on periodic discrete-time observations. Mathematical Control and Related Fields, 2020, 10 (4) : 715-734. doi: 10.3934/mcrf.2020017
[12]	Byungik Kahng, Miguel Mendes. The characterization of maximal invariant sets of non-linear discrete-time control dynamical systems. Conference Publications, 2013, 2013 (special) : 393-406. doi: 10.3934/proc.2013.2013.393
[13]	Victor Kozyakin. Minimax joint spectral radius and stabilizability of discrete-time linear switching control systems. Discrete and Continuous Dynamical Systems - B, 2019, 24 (8) : 3537-3556. doi: 10.3934/dcdsb.2018277
[14]	Yueyuan Zhang, Yanyan Yin, Fei Liu. Robust observer-based control for discrete-time semi-Markov jump systems with actuator saturation. Journal of Industrial and Management Optimization, 2021, 17 (6) : 3013-3026. doi: 10.3934/jimo.2020105
[15]	Yadong Shu, Bo Li. Linear-quadratic optimal control for discrete-time stochastic descriptor systems. Journal of Industrial and Management Optimization, 2022, 18 (3) : 1583-1602. doi: 10.3934/jimo.2021034
[16]	Yuyun Zhao, Yi Zhang, Tao Xu, Ling Bai, Qian Zhang. pth moment exponential stability of hybrid stochastic functional differential equations by feedback control based on discrete-time state observations. Discrete and Continuous Dynamical Systems - B, 2017, 22 (1) : 209-226. doi: 10.3934/dcdsb.2017011
[17]	Mikhail Gusev. On reachability analysis for nonlinear control systems with state constraints. Conference Publications, 2015, 2015 (special) : 579-587. doi: 10.3934/proc.2015.0579
[18]	Alexander J. Zaslavski. The turnpike property of discrete-time control problems arising in economic dynamics. Discrete and Continuous Dynamical Systems - B, 2005, 5 (3) : 861-880. doi: 10.3934/dcdsb.2005.5.861
[19]	Shaohong Fang, Jing Huang, Jinying Ma. Stabilization of a discrete-time system via nonlinear impulsive control. Discrete and Continuous Dynamical Systems - S, 2020, 13 (6) : 1803-1811. doi: 10.3934/dcdss.2020106
[20]	Jingang Zhao, Chi Zhang. Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning. Journal of Industrial and Management Optimization, 2021, 17 (3) : 1471-1483. doi: 10.3934/jimo.2020030

2020 Impact Factor: 1.801

Tools

Metrics

Other articles
by authors

on AIMS
Yuefen Chen Yuanguo Zhu
on Google Scholar
Yuefen Chen Yuanguo Zhu

2020 Impact Factor: 1.801

Tools

Article outline

2020 Impact Factor: 1.801

Tools

Metrics

Other articles
by authors

on AIMS
Yuefen Chen Yuanguo Zhu
on Google Scholar
Yuefen Chen Yuanguo Zhu

[Back to Top]