American Institute of Mathematical Sciences

Advanced
  • Previous Article
    Analysis of the Newsboy Problem subject to price dependent demand and multiple discounts
  • JIMO Home
  • This Issue
  • Next Article
    On optimality conditions and duality for non-differentiable interval-valued programming problems with the generalized (F, ρ)-convexity
July  2018, 14(3): 913-930. doi: 10.3934/jimo.2017082

Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems

Yuefen Chen 1, and  Yuanguo Zhu 2,,

1. 

School of Mathematics and Statistics, Xinyang Normal University, Xinyang, Henan 464000, China
2. 

School of Science, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China

* Corresponding author: ygzhu@njust.edu.cn

Received  February 2016 Revised  August 2017 Published  September 2017

Fund Project: This work is supported by the National Natural Science Foundation of China (No.61673011), the Nanhu Scholars Program for Young Scholars of XYNU and the Key Scientific Research Project for Colleges and Universities of Henan Province (No.17A120013).

Uncertainty theory is a branch of axiomatic mathematics that deals with human uncertainty. Based on uncertainty theory, this paper discusses linear quadratic (LQ) optimal control with process state inequality constraints for discrete-time uncertain systems, where the weighting matrices in the cost function are assumed to be indefinite. By means of the maximum principle with mixed inequality constraints, we present a necessary condition for the existence of optimal state feedback control that involves a constrained difference equation. Moreover, the existence of a solution to the constrained difference equation is equivalent to the solvability of the indefinite LQ problem. Furthermore, the well-posedness of the indefinite LQ problem is proved. Finally, an example is provided to demonstrate the effectiveness of our theoretical results.

Keywords: Indefinite LQ control, process state inequality constraints, discrete-time uncertain systems, constrained difference equation.
Mathematics Subject Classification: Primary: 49N10, 49L20; Secondary: 65K05.
Citation: Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial & Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082
References:
[1]

M. Athans, The matrix minimum principle, Information and Control, 11 (1967), 592-606.  doi: 10.1016/S0019-9958(67)90803-0.  Google Scholar

[2]

K. Bahlali, B. Djehiche and B. Mezerdi, On the stochastic maximum principle in optimal control of degenerate diffusions with Lipschitz coefficients, Applied Mathematics and Optimization, 56 (2007), 364-378.  doi: 10.1007/s00245-007-9017-6.  Google Scholar

[3]

A. Bensoussan, S. P. Sethi, R. G. Vickson and N. Derzko, Stochastic production planning with production constraints: A summary, SIAM Journal on Control and Optimization, 22 (1984), 920-935.  doi: 10.1137/0322060.  Google Scholar

[4]

D. P. Bertsekas, Dynamic Programming and Stochastic Control, Mathematics in Science and Engineering, 125. Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1976.  Google Scholar

[5]

S. P. Chen, X. J. Li and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Control and Optimization, 36 (1998), 1685-1702.  doi: 10.1137/S0363012996310478.  Google Scholar

[6]

X. Chen, Y. Liu and D. A. Ralescu, Uncertain stock model with periodic dividends, Fuzzy Optimization and Decision Making, 12 (2013), 111-123.  doi: 10.1007/s10700-012-9141-x.  Google Scholar

[7]

Y. Gao, Uncertain models for single facility location problems on networks, Applied Mathematical Modelling, 36 (2012), 2592-2599.  doi: 10.1016/j.apm.2011.09.042.  Google Scholar

[8]

M. R. Hestenes, Calculus of Variations and Optimal Control Theory Wiley, New York, 1966.  Google Scholar

[9]

Y. Hu and X. Y. Zhou, Constrained stochastic LQ control with random coefficients, and application to portfolio selection, SIAM Journal on Control and Optimization, 44 (2005), 444-466.  doi: 10.1137/S0363012904441969.  Google Scholar

[10]

D. Kahneman and A. Tversky, Prospect theory: an analysis of decision under risk, Econometrica, 47 (1979), 263-292.   Google Scholar

[11]

X. Li and X. Y. Zhou, Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon, Communications on Information and Systems, 2 (2002), 265-282.  doi: 10.4310/CIS.2002.v2.n3.a4.  Google Scholar

[12]

B. Liu, Uncertainty Theory 2nd edition, Springer-Verlag, Berlin, 2004. doi: 10.1007/978-3-540-39987-2.  Google Scholar

[13]

B. Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty Springer-Verlag, Heidelberg, 2015. doi: 10.1007/978-3-662-44354-5.  Google Scholar

[14]

B. Liu, Some research problems in uncertainty theory, Journal of Uncertain Systems, 3 (2009), 3-10.   Google Scholar

[15]

X. Liu, Y. Li and W. Zhang, Stochastic linear quadratic optimal control with constraint for discrete-time systems, Applied Mathematics and Computation, 228 (2014), 264-270.  doi: 10.1016/j.amc.2013.09.036.  Google Scholar

[16]

B. Liu and K. Yao, Uncertain multilevel programming: Algorithm and applications, Computers and Industrial Engineering, 89 (2014), 235-240.  doi: 10.1016/j.cie.2014.09.029.  Google Scholar

[17]

R. Penrose, A generalized inverse of matrices, Mathematical Proceedings of the Cambridge Philosophical Society, 51 (1955), 406-413.  doi: 10.1017/S0305004100030401.  Google Scholar

[18]

L. Sheng and Y. Zhu, Optimistic value model of uncertain optimal control, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 21 (2013), 75-87.  doi: 10.1142/S0218488513400060.  Google Scholar

[19]

Y. Shu and Y. Zhu, Stability and optimal control for uncertain continuous-time singular systems, European Journal of Control, 34 (2017), 16-23.  doi: 10.1016/j.ejcon.2016.12.003.  Google Scholar

[20]

V. K. Socgnia and O. Menoukeu-Pamen, An infinite horizon stochastic maximum principle for discounted control problem with Lipschitz coefficients, Journal of Mathematical Analysis and Applications, 422 (2015), 684-711.  doi: 10.1016/j.jmaa.2014.09.010.  Google Scholar

[21]

Z. Wang, J. Guo, M. Zheng and Y. Yang, A new approach for uncertain multiobjective programming problem based on $\mathcal{P}_E$ principle, Journal of Industrial and Management Optimization, 11 (2015), 13-26.  doi: 10.3934/jimo.2015.11.13.  Google Scholar

[22]

W. M. Wonham, On a matrix Riccati equation of stochastic control, SIAM Journal on Control and Optimization, 6 (1968), 681-697.  doi: 10.1137/0306044.  Google Scholar

[23]

H. Yan, Y. Sun and Y. Zhu, A linear-quadratic control problem of uncertain discrete-time switched systems, Journal of Industrial and Management Optimization, 13 (2017), 267-282.  doi: 10.3934/jimo.2016016.  Google Scholar

[24]

J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations Springer, New York, 1999. doi: 10.1007/978-1-4612-1466-3.  Google Scholar

[25]

W. Zhang, H. Zhang and B. S. Chen, Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion, IEEE Transactions on Automatic Control, 53 (2008), 1630-1642.  doi: 10.1109/TAC.2008.929368.  Google Scholar

[26]

W. Zhang and B. S. Chen, On stabilizability and exact observability of stochastic systems with their applications, Automatica, 40 (2004), 87-94.  doi: 10.1016/j.automatica.2003.07.002.  Google Scholar

[27]

W. Zhang and G. Li, Discrete-time indefinite stochastic linear quadratic optimal control with second moment constraints Mathematical Problems in Engineering 2014 (2014), Art. ID 278142, 9 pp. doi: 10.1155/2014/278142.  Google Scholar

[28]

X. Y. Zhou and D. Li, Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization, 42 (2000), 19-33.  doi: 10.1007/s002450010003.  Google Scholar

[29]

Y. Zhu, Uncertain optimal control with application to a portfolio selection model, Cybernetics and Systems: An International Journal, 41 (2010), 535-547.  doi: 10.1080/01969722.2010.511552.  Google Scholar

[30]

Y. Zhu, Functions of uncertain variables and uncertain programming, Journal of Uncertain Systems, 6 (2012), 278-288.   Google Scholar

show all references

References:
[1]

M. Athans, The matrix minimum principle, Information and Control, 11 (1967), 592-606.  doi: 10.1016/S0019-9958(67)90803-0.  Google Scholar

[2]

K. Bahlali, B. Djehiche and B. Mezerdi, On the stochastic maximum principle in optimal control of degenerate diffusions with Lipschitz coefficients, Applied Mathematics and Optimization, 56 (2007), 364-378.  doi: 10.1007/s00245-007-9017-6.  Google Scholar

[3]

A. Bensoussan, S. P. Sethi, R. G. Vickson and N. Derzko, Stochastic production planning with production constraints: A summary, SIAM Journal on Control and Optimization, 22 (1984), 920-935.  doi: 10.1137/0322060.  Google Scholar

[4]

D. P. Bertsekas, Dynamic Programming and Stochastic Control, Mathematics in Science and Engineering, 125. Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1976.  Google Scholar

[5]

S. P. Chen, X. J. Li and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Control and Optimization, 36 (1998), 1685-1702.  doi: 10.1137/S0363012996310478.  Google Scholar

[6]

X. Chen, Y. Liu and D. A. Ralescu, Uncertain stock model with periodic dividends, Fuzzy Optimization and Decision Making, 12 (2013), 111-123.  doi: 10.1007/s10700-012-9141-x.  Google Scholar

[7]

Y. Gao, Uncertain models for single facility location problems on networks, Applied Mathematical Modelling, 36 (2012), 2592-2599.  doi: 10.1016/j.apm.2011.09.042.  Google Scholar

[8]

M. R. Hestenes, Calculus of Variations and Optimal Control Theory Wiley, New York, 1966.  Google Scholar

[9]

Y. Hu and X. Y. Zhou, Constrained stochastic LQ control with random coefficients, and application to portfolio selection, SIAM Journal on Control and Optimization, 44 (2005), 444-466.  doi: 10.1137/S0363012904441969.  Google Scholar

[10]

D. Kahneman and A. Tversky, Prospect theory: an analysis of decision under risk, Econometrica, 47 (1979), 263-292.   Google Scholar

[11]

X. Li and X. Y. Zhou, Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon, Communications on Information and Systems, 2 (2002), 265-282.  doi: 10.4310/CIS.2002.v2.n3.a4.  Google Scholar

[12]

B. Liu, Uncertainty Theory 2nd edition, Springer-Verlag, Berlin, 2004. doi: 10.1007/978-3-540-39987-2.  Google Scholar

[13]

B. Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty Springer-Verlag, Heidelberg, 2015. doi: 10.1007/978-3-662-44354-5.  Google Scholar

[14]

B. Liu, Some research problems in uncertainty theory, Journal of Uncertain Systems, 3 (2009), 3-10.   Google Scholar

[15]

X. Liu, Y. Li and W. Zhang, Stochastic linear quadratic optimal control with constraint for discrete-time systems, Applied Mathematics and Computation, 228 (2014), 264-270.  doi: 10.1016/j.amc.2013.09.036.  Google Scholar

[16]

B. Liu and K. Yao, Uncertain multilevel programming: Algorithm and applications, Computers and Industrial Engineering, 89 (2014), 235-240.  doi: 10.1016/j.cie.2014.09.029.  Google Scholar

[17]

R. Penrose, A generalized inverse of matrices, Mathematical Proceedings of the Cambridge Philosophical Society, 51 (1955), 406-413.  doi: 10.1017/S0305004100030401.  Google Scholar

[18]

L. Sheng and Y. Zhu, Optimistic value model of uncertain optimal control, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 21 (2013), 75-87.  doi: 10.1142/S0218488513400060.  Google Scholar

[19]

Y. Shu and Y. Zhu, Stability and optimal control for uncertain continuous-time singular systems, European Journal of Control, 34 (2017), 16-23.  doi: 10.1016/j.ejcon.2016.12.003.  Google Scholar

[20]

V. K. Socgnia and O. Menoukeu-Pamen, An infinite horizon stochastic maximum principle for discounted control problem with Lipschitz coefficients, Journal of Mathematical Analysis and Applications, 422 (2015), 684-711.  doi: 10.1016/j.jmaa.2014.09.010.  Google Scholar

[21]

Z. Wang, J. Guo, M. Zheng and Y. Yang, A new approach for uncertain multiobjective programming problem based on $\mathcal{P}_E$ principle, Journal of Industrial and Management Optimization, 11 (2015), 13-26.  doi: 10.3934/jimo.2015.11.13.  Google Scholar

[22]

W. M. Wonham, On a matrix Riccati equation of stochastic control, SIAM Journal on Control and Optimization, 6 (1968), 681-697.  doi: 10.1137/0306044.  Google Scholar

[23]

H. Yan, Y. Sun and Y. Zhu, A linear-quadratic control problem of uncertain discrete-time switched systems, Journal of Industrial and Management Optimization, 13 (2017), 267-282.  doi: 10.3934/jimo.2016016.  Google Scholar

[24]

J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations Springer, New York, 1999. doi: 10.1007/978-1-4612-1466-3.  Google Scholar

[25]

W. Zhang, H. Zhang and B. S. Chen, Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion, IEEE Transactions on Automatic Control, 53 (2008), 1630-1642.  doi: 10.1109/TAC.2008.929368.  Google Scholar

[26]

W. Zhang and B. S. Chen, On stabilizability and exact observability of stochastic systems with their applications, Automatica, 40 (2004), 87-94.  doi: 10.1016/j.automatica.2003.07.002.  Google Scholar

[27]

W. Zhang and G. Li, Discrete-time indefinite stochastic linear quadratic optimal control with second moment constraints Mathematical Problems in Engineering 2014 (2014), Art. ID 278142, 9 pp. doi: 10.1155/2014/278142.  Google Scholar

[28]

X. Y. Zhou and D. Li, Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization, 42 (2000), 19-33.  doi: 10.1007/s002450010003.  Google Scholar

[29]

Y. Zhu, Uncertain optimal control with application to a portfolio selection model, Cybernetics and Systems: An International Journal, 41 (2010), 535-547.  doi: 10.1080/01969722.2010.511552.  Google Scholar

[30]

Y. Zhu, Functions of uncertain variables and uncertain programming, Journal of Uncertain Systems, 6 (2012), 278-288.   Google Scholar

[1]

Elena K. Kostousova. On polyhedral control synthesis for dynamical discrete-time systems under uncertainties and state constraints. Discrete & Continuous Dynamical Systems - A, 2018, 38 (12) : 6149-6162. doi: 10.3934/dcds.2018153
[2]

Hongyan Yan, Yun Sun, Yuanguo Zhu. A linear-quadratic control problem of uncertain discrete-time switched systems. Journal of Industrial & Management Optimization, 2017, 13 (1) : 267-282. doi: 10.3934/jimo.2016016
[3]

Elena K. Kostousova. On control synthesis for uncertain dynamical discrete-time systems through polyhedral techniques. Conference Publications, 2015, 2015 (special) : 723-732. doi: 10.3934/proc.2015.0723
[4]

Martino Bardi, Shigeaki Koike, Pierpaolo Soravia. Pursuit-evasion games with state constraints: dynamic programming and discrete-time approximations. Discrete & Continuous Dynamical Systems - A, 2000, 6 (2) : 361-380. doi: 10.3934/dcds.2000.6.361
[5]

Xi Zhu, Meixia Li, Chunfa Li. Consensus in discrete-time multi-agent systems with uncertain topologies and random delays governed by a Markov chain. Discrete & Continuous Dynamical Systems - B, 2020, 25 (12) : 4535-4551. doi: 10.3934/dcdsb.2020111
[6]

Haijun Sun, Xinquan Zhang. Guaranteed cost control of discrete-time switched saturated systems. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020300
[7]

Guangjun Shen, Xueying Wu, Xiuwei Yin. Stabilization of stochastic differential equations driven by G-Lévy process with discrete-time feedback control. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 755-774. doi: 10.3934/dcdsb.2020133
[8]

Aleksandar Zatezalo, Dušan M. Stipanović. Control of dynamical systems with discrete and uncertain observations. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4665-4681. doi: 10.3934/dcds.2015.35.4665
[9]

Chuandong Li, Fali Ma, Tingwen Huang. 2-D analysis based iterative learning control for linear discrete-time systems with time delay. Journal of Industrial & Management Optimization, 2011, 7 (1) : 175-181. doi: 10.3934/jimo.2011.7.175
[10]

Ran Dong, Xuerong Mao. Asymptotic stabilization of continuous-time periodic stochastic systems by feedback control based on periodic discrete-time observations. Mathematical Control & Related Fields, 2020, 10 (4) : 715-734. doi: 10.3934/mcrf.2020017
[11]

Byungik Kahng, Miguel Mendes. The characterization of maximal invariant sets of non-linear discrete-time control dynamical systems. Conference Publications, 2013, 2013 (special) : 393-406. doi: 10.3934/proc.2013.2013.393
[12]

Yadong Shu, Bo Li. Linear-quadratic optimal control for discrete-time stochastic descriptor systems. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021034
[13]

Victor Kozyakin. Minimax joint spectral radius and stabilizability of discrete-time linear switching control systems. Discrete & Continuous Dynamical Systems - B, 2019, 24 (8) : 3537-3556. doi: 10.3934/dcdsb.2018277
[14]

Yueyuan Zhang, Yanyan Yin, Fei Liu. Robust observer-based control for discrete-time semi-Markov jump systems with actuator saturation. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020105
[15]

Yuyun Zhao, Yi Zhang, Tao Xu, Ling Bai, Qian Zhang. pth moment exponential stability of hybrid stochastic functional differential equations by feedback control based on discrete-time state observations. Discrete & Continuous Dynamical Systems - B, 2017, 22 (1) : 209-226. doi: 10.3934/dcdsb.2017011
[16]

Mikhail Gusev. On reachability analysis for nonlinear control systems with state constraints. Conference Publications, 2015, 2015 (special) : 579-587. doi: 10.3934/proc.2015.0579
[17]

Alexander J. Zaslavski. The turnpike property of discrete-time control problems arising in economic dynamics. Discrete & Continuous Dynamical Systems - B, 2005, 5 (3) : 861-880. doi: 10.3934/dcdsb.2005.5.861
[18]

Shaohong Fang, Jing Huang, Jinying Ma. Stabilization of a discrete-time system via nonlinear impulsive control. Discrete & Continuous Dynamical Systems - S, 2020, 13 (6) : 1803-1811. doi: 10.3934/dcdss.2020106
[19]

Jingang Zhao, Chi Zhang. Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning. Journal of Industrial & Management Optimization, 2021, 17 (3) : 1471-1483. doi: 10.3934/jimo.2020030
[20]

Eduardo Casas, Fredi Tröltzsch. Sparse optimal control for the heat equation with mixed control-state constraints. Mathematical Control & Related Fields, 2020, 10 (3) : 471-491. doi: 10.3934/mcrf.2020007

2019 Impact Factor: 1.366

Tools

Metrics

  • PDF downloads (125)
  • HTML views (892)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences