American Institute of Mathematical Sciences

Advanced
April  2019, 15(2): 817-832. doi: 10.3934/jimo.2018072

On the global optimal solution for linear quadratic problems of switched system

Jin Feng He 1, , Wei Xu 2, , Zhi Guo Feng 1,3,, and  Xinsong Yang 1,

1. 

College of Mathematics Science, Chongqing Normal University, Chongqing, China
2. 

School of Management, Shanghai University, Shanghai, China
3. 

Faculty of Mathematics and Computer Science, Guangdong Ocean University, Zhanjiang, Guangdong, China

* Corresponding author: Zhi Guo Feng

Received  December 2016 Revised  March 2018 Published  April 2019 Early access  June 2018

The global optimal solution for the optimal switching problem is considered in discrete time, where these subsystems are linear and the cost functional is quadratic. The optimal switching problem is a discrete optimization problem. Complete enumeration search is always required to find the global optimal solution, which is very expensive. Relaxation method is an effective method to transform the discrete optimization problem into the continuous optimization problem, while the optimal solution is always not the feasible solution of the discrete optimization problem. In this paper, we propose a special class of relaxation method to transform the optimal switching problem into a relaxed optimization problem. We prove that the optimal solution of this modified relaxed optimization problem is exactly that of the optimal switching problem. Then, the global optimal solution can be obtained by solving the continuous optimization problem easily. Numerical examples are demonstrated to show that the modified relaxation method is efficient and effective to obtain the global optimal solution.

Keywords: Global optimal solution, optimal switching problem, switching sequence, relaxation method.
Mathematics Subject Classification: Primary: 49M20, 34K35.
Citation: Jin Feng He, Wei Xu, Zhi Guo Feng, Xinsong Yang. On the global optimal solution for linear quadratic problems of switched system. Journal of Industrial & Management Optimization, 2019, 15 (2) : 817-832. doi: 10.3934/jimo.2018072
References:
[1]

H. Axelsson, Y. Wardi, M. Egerstedt and E. I. Verriest, Gradient descent approach to optiomal mode scheduling in hybrid dynamical systems, Journal of Optimization Theory and Applications, 136 (2008), 167-186.  doi: 10.1007/s10957-007-9305-y.  Google Scholar

[2]

S. C. Bengea and R. A. DeCarlo, Optimal control of switching systems, Automatica, 41 (2005), 11-27.  doi: 10.1016/j.automatica.2004.08.003.  Google Scholar

[3]

M. Egerstedt, Y. Wardi and H. Axelsson, Transition-time optimization for switched-mode dynamical systems, IEEE Transactions on Automatic Control, 51 (2006), 110-115.  doi: 10.1109/TAC.2005.861711.  Google Scholar

[4]

Z. G. Feng, K. L. Teo and V. Rehbock, Hybrid method for a general optimal sensor scheduling problem in discrete time, Automatica, 44 (2008), 1295-1303.  doi: 10.1016/j.automatica.2007.09.024.  Google Scholar

[5]

Z. G. Feng, K. L. Teo and Y. Zhao, Branch and bound method for sensor scheduling in discrete time, Journal of Industrial and Management Optimization, 1 (2005), 499-512.  doi: 10.3934/jimo.2005.1.499.  Google Scholar

[6]

Z. G. Feng, Z.G. Feng, K. L. Teo and V. Rehbock, A discrete filled function method for the optimal control of switched systems in discrete time, Optimal Control, Applications and Methods, 30 (2009), 583-593.  doi: 10.1002/oca.885.  Google Scholar

[7]

R. Li, K. L. Teo, K. H. Wong and G. R. Duan, Control parametrization enhancing transform for optimal control of switched systems, Mathematical and Computer Modelling, 43 (2006), 1393-1403.  doi: 10.1016/j.mcm.2005.08.012.  Google Scholar

[8]

R. Li, Z. G. Feng, K. L. Teo and G. R. Duan, Optimal Piecewise State Feedback Control for Impulsive Switched Systems, Mathematical and Computer Modelling, 48 (2008), 468-479.  doi: 10.1016/j.mcm.2007.06.028.  Google Scholar

[9]

Q. Lin, R. Loxton and K. L. Teo, Optimal control of nonlinear switched systems: Computational methods and applications, Journal of the Operations Research Society of China, 1 (2013), 275-311.  doi: 10.1007/s40305-013-0021-z.  Google Scholar

[10]

C. Liu, R. Loxton and K. L. Teo, Optimal parameter selection for nonlinear multistage systems with time-delays, Computational Optimization and Applications, 59 (2014), 285-306.  doi: 10.1007/s10589-013-9632-x.  Google Scholar

[11]

C. Liu, Z. Gong, K. L. Teo, J. Sun and L. Caccetta, Robust multi-objective optimal switching control arising in 1,3-propanediol microbial fed-batch process, Nonlinear Analysis Hybrid Systems, 25 (2017), 1-20.  doi: 10.1016/j.nahs.2017.01.006.  Google Scholar

[12]

C. Liu, R. Loxton and K. L. Teo, Switching time and parameter optimization in nonlinear switched systems with multiple time-delays, Journal of Optimization Theory and Applications, 163 (2014), 957-988.  doi: 10.1007/s10957-014-0533-7.  Google Scholar

[13]

C. Liu and Z. Gong, Optimal Control of Switched Systems Arising in Fermentation Processes, Springer-Verlag, Berlin, 2014. doi: 10.1007/978-3-662-43793-3.  Google Scholar

[14]

Q. Long and C. Wu, A hybrid method combining genetic algorithm and Hooke-Jeeves method for constrained global optimization, Journal of Industrial and Management Optimization, 10 (2014), 1279-1296.  doi: 10.3934/jimo.2014.10.1279.  Google Scholar

[15]

R. Loxton, K. L. Teo, V. Rehbock and W. K. Ling, Optimal switching instants for a switched-capacitor DC/DC power converter, Automatica, 45 (2009), 973-980.  doi: 10.1016/j.automatica.2008.10.031.  Google Scholar

[16]

B. Piccoli, Hybrid systems and optimal control, in Proceedings of the 37th IEEE Conference on Decision and Control, 1998, 13–18. doi: 10.1109/CDC.1998.760582.  Google Scholar

[17]

E. Rentsen, J. Zhou and K. L. Teo, A global optimization approach to fractional optimal control, Journal of Industrial and Management Optimization, 12 (2016), 73-82.  doi: 10.3934/jimo.2016.12.73.  Google Scholar

[18]

M. Soler, A. Olivares and E. Staffetti, Hybrid optimal control approach to commercial aircraft trajectory planning, Journal of Guidance, Control, and Dynamics, 33 (2010), 985-991.   Google Scholar

[19]

H. J. Sussmann, A maximum principle for hybrid optimal control problems, in Proceedings of the 38th IEEE Conference on Decision and Control, 1999, 425–430. doi: 10.1109/CDC.1999.832814.  Google Scholar

[20]

K. L. Teo, L. S. Jennings, H. W. J. Lee and V. Rehbock, The control parametrization enhancing transform for constrained optimal control problems, Journal of Australian Mathematical Society, 40 (1999), 314-335.  doi: 10.1017/S0334270000010936.  Google Scholar

[21]

C. Wu and K. L. Teo, Global impulsive optimal control computation, Journal of Industrial and Management Optimization, 2 (2006), 435-450.  doi: 10.3934/jimo.2006.2.435.  Google Scholar

[22]

C. Wu, K. L. Teo and S. Wu, Min-max optimal control of linear systems with uncertainty and terminal state constraints, Automatica, 49 (2013), 1809-1815.  doi: 10.1016/j.automatica.2013.02.052.  Google Scholar

[23]

C. Wu, K. L. Teo, R. Li and Y. Zhao, Optimal control of switched systems with time delay, Applied Mathematics Letters, 19 (2006), 1062-1067.  doi: 10.1016/j.aml.2005.11.018.  Google Scholar

[24]

X. Xu and P. J. Antsaklis, Optimal control of switched systems based on parameterization of the switching instants, IEEE Transactions on Automatic Control, 49 (2004), 2-16.  doi: 10.1109/TAC.2003.821417.  Google Scholar

[25]

W. Xu, Z. G. Feng, J. W. Peng and K. F. C. Yiu, Optimal switching for linear quadratic problem of switched systems in discrete time, Automatica, 78 (2017), 185-193.  doi: 10.1016/j.automatica.2016.12.002.  Google Scholar

[26]

F. Yang, K. L. Teo, R. Loxton, V. Rehbock, B. Li, C. Yu and L. Jennings, Visual miser: An efficient user-friendly visual program for solving optimal control problems, Journal of Industrial and Management Optimization, 12 (2016), 781-810.  doi: 10.3934/jimo.2016.12.781.  Google Scholar

[27]

J. Zhai, T. Niu, J. Ye and E. Feng, Optimal control of nonlinear switched system with mixed constraints and its parallel optimization algorithm, Nonlinear Analysis Hybrid Systems, 25 (2017), 21-40.  doi: 10.1016/j.nahs.2017.02.001.  Google Scholar

[28]

C. Zhao, C. Wu, J. Chai, X. Wang, X. Yang, J. M. Lee and M. J. Kim, Decomposition-based multi-objective firefly algorithm for RFID network planning with uncertainty, Applied Soft Computing, 55 (2017), 549-564.  doi: 10.1016/j.asoc.2017.02.009.  Google Scholar

[29]

X. L. Zhu, Z. G. Feng and J. W. Peng, Robust design of sensor fusion problem in discrete time, Journal of Industrial and Management Optimization, 13 (2017), 825-834.  doi: 10.3934/jimo.2016048.  Google Scholar

show all references

References:
[1]

H. Axelsson, Y. Wardi, M. Egerstedt and E. I. Verriest, Gradient descent approach to optiomal mode scheduling in hybrid dynamical systems, Journal of Optimization Theory and Applications, 136 (2008), 167-186.  doi: 10.1007/s10957-007-9305-y.  Google Scholar

[2]

S. C. Bengea and R. A. DeCarlo, Optimal control of switching systems, Automatica, 41 (2005), 11-27.  doi: 10.1016/j.automatica.2004.08.003.  Google Scholar

[3]

M. Egerstedt, Y. Wardi and H. Axelsson, Transition-time optimization for switched-mode dynamical systems, IEEE Transactions on Automatic Control, 51 (2006), 110-115.  doi: 10.1109/TAC.2005.861711.  Google Scholar

[4]

Z. G. Feng, K. L. Teo and V. Rehbock, Hybrid method for a general optimal sensor scheduling problem in discrete time, Automatica, 44 (2008), 1295-1303.  doi: 10.1016/j.automatica.2007.09.024.  Google Scholar

[5]

Z. G. Feng, K. L. Teo and Y. Zhao, Branch and bound method for sensor scheduling in discrete time, Journal of Industrial and Management Optimization, 1 (2005), 499-512.  doi: 10.3934/jimo.2005.1.499.  Google Scholar

[6]

Z. G. Feng, Z.G. Feng, K. L. Teo and V. Rehbock, A discrete filled function method for the optimal control of switched systems in discrete time, Optimal Control, Applications and Methods, 30 (2009), 583-593.  doi: 10.1002/oca.885.  Google Scholar

[7]

R. Li, K. L. Teo, K. H. Wong and G. R. Duan, Control parametrization enhancing transform for optimal control of switched systems, Mathematical and Computer Modelling, 43 (2006), 1393-1403.  doi: 10.1016/j.mcm.2005.08.012.  Google Scholar

[8]

R. Li, Z. G. Feng, K. L. Teo and G. R. Duan, Optimal Piecewise State Feedback Control for Impulsive Switched Systems, Mathematical and Computer Modelling, 48 (2008), 468-479.  doi: 10.1016/j.mcm.2007.06.028.  Google Scholar

[9]

Q. Lin, R. Loxton and K. L. Teo, Optimal control of nonlinear switched systems: Computational methods and applications, Journal of the Operations Research Society of China, 1 (2013), 275-311.  doi: 10.1007/s40305-013-0021-z.  Google Scholar

[10]

C. Liu, R. Loxton and K. L. Teo, Optimal parameter selection for nonlinear multistage systems with time-delays, Computational Optimization and Applications, 59 (2014), 285-306.  doi: 10.1007/s10589-013-9632-x.  Google Scholar

[11]

C. Liu, Z. Gong, K. L. Teo, J. Sun and L. Caccetta, Robust multi-objective optimal switching control arising in 1,3-propanediol microbial fed-batch process, Nonlinear Analysis Hybrid Systems, 25 (2017), 1-20.  doi: 10.1016/j.nahs.2017.01.006.  Google Scholar

[12]

C. Liu, R. Loxton and K. L. Teo, Switching time and parameter optimization in nonlinear switched systems with multiple time-delays, Journal of Optimization Theory and Applications, 163 (2014), 957-988.  doi: 10.1007/s10957-014-0533-7.  Google Scholar

[13]

C. Liu and Z. Gong, Optimal Control of Switched Systems Arising in Fermentation Processes, Springer-Verlag, Berlin, 2014. doi: 10.1007/978-3-662-43793-3.  Google Scholar

[14]

Q. Long and C. Wu, A hybrid method combining genetic algorithm and Hooke-Jeeves method for constrained global optimization, Journal of Industrial and Management Optimization, 10 (2014), 1279-1296.  doi: 10.3934/jimo.2014.10.1279.  Google Scholar

[15]

R. Loxton, K. L. Teo, V. Rehbock and W. K. Ling, Optimal switching instants for a switched-capacitor DC/DC power converter, Automatica, 45 (2009), 973-980.  doi: 10.1016/j.automatica.2008.10.031.  Google Scholar

[16]

B. Piccoli, Hybrid systems and optimal control, in Proceedings of the 37th IEEE Conference on Decision and Control, 1998, 13–18. doi: 10.1109/CDC.1998.760582.  Google Scholar

[17]

E. Rentsen, J. Zhou and K. L. Teo, A global optimization approach to fractional optimal control, Journal of Industrial and Management Optimization, 12 (2016), 73-82.  doi: 10.3934/jimo.2016.12.73.  Google Scholar

[18]

M. Soler, A. Olivares and E. Staffetti, Hybrid optimal control approach to commercial aircraft trajectory planning, Journal of Guidance, Control, and Dynamics, 33 (2010), 985-991.   Google Scholar

[19]

H. J. Sussmann, A maximum principle for hybrid optimal control problems, in Proceedings of the 38th IEEE Conference on Decision and Control, 1999, 425–430. doi: 10.1109/CDC.1999.832814.  Google Scholar

[20]

K. L. Teo, L. S. Jennings, H. W. J. Lee and V. Rehbock, The control parametrization enhancing transform for constrained optimal control problems, Journal of Australian Mathematical Society, 40 (1999), 314-335.  doi: 10.1017/S0334270000010936.  Google Scholar

[21]

C. Wu and K. L. Teo, Global impulsive optimal control computation, Journal of Industrial and Management Optimization, 2 (2006), 435-450.  doi: 10.3934/jimo.2006.2.435.  Google Scholar

[22]

C. Wu, K. L. Teo and S. Wu, Min-max optimal control of linear systems with uncertainty and terminal state constraints, Automatica, 49 (2013), 1809-1815.  doi: 10.1016/j.automatica.2013.02.052.  Google Scholar

[23]

C. Wu, K. L. Teo, R. Li and Y. Zhao, Optimal control of switched systems with time delay, Applied Mathematics Letters, 19 (2006), 1062-1067.  doi: 10.1016/j.aml.2005.11.018.  Google Scholar

[24]

X. Xu and P. J. Antsaklis, Optimal control of switched systems based on parameterization of the switching instants, IEEE Transactions on Automatic Control, 49 (2004), 2-16.  doi: 10.1109/TAC.2003.821417.  Google Scholar

[25]

W. Xu, Z. G. Feng, J. W. Peng and K. F. C. Yiu, Optimal switching for linear quadratic problem of switched systems in discrete time, Automatica, 78 (2017), 185-193.  doi: 10.1016/j.automatica.2016.12.002.  Google Scholar

[26]

F. Yang, K. L. Teo, R. Loxton, V. Rehbock, B. Li, C. Yu and L. Jennings, Visual miser: An efficient user-friendly visual program for solving optimal control problems, Journal of Industrial and Management Optimization, 12 (2016), 781-810.  doi: 10.3934/jimo.2016.12.781.  Google Scholar

[27]

J. Zhai, T. Niu, J. Ye and E. Feng, Optimal control of nonlinear switched system with mixed constraints and its parallel optimization algorithm, Nonlinear Analysis Hybrid Systems, 25 (2017), 21-40.  doi: 10.1016/j.nahs.2017.02.001.  Google Scholar

[28]

C. Zhao, C. Wu, J. Chai, X. Wang, X. Yang, J. M. Lee and M. J. Kim, Decomposition-based multi-objective firefly algorithm for RFID network planning with uncertainty, Applied Soft Computing, 55 (2017), 549-564.  doi: 10.1016/j.asoc.2017.02.009.  Google Scholar

[29]

X. L. Zhu, Z. G. Feng and J. W. Peng, Robust design of sensor fusion problem in discrete time, Journal of Industrial and Management Optimization, 13 (2017), 825-834.  doi: 10.3934/jimo.2016048.  Google Scholar

Figure 1.  Optimal weight of the first subsystem obtained by relaxation method and modified relaxation method in Example 1
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Optimal weight of the second subsystem obtained by relaxation method and modified relaxation method in Example 1
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  Optimal weight of the third subsystem obtained by relaxation method and modified relaxation method in Example 1
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4.  Optimal solution and truncated solution in Example 1
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  Optimal weight of the first subsystem obtained by relaxation method and modified relaxation method in Example 2
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  Optimal weight of the second subsystem obtained by relaxation method and modified relaxation method in Example 2
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7.  Optimal weight of the third subsystem obtained by relaxation method and modified relaxation method in Example 2
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8.  Optimal solution and truncated solution in Example 2
Figure Options

Download full-size image

Download as PowerPoint slide

[1]

Wei Xu, Liying Yu, Gui-Hua Lin, Zhi Guo Feng. Optimal switching signal design with a cost on switching action. Journal of Industrial & Management Optimization, 2020, 16 (5) : 2531-2549. doi: 10.3934/jimo.2019068
[2]

Fabio Bagagiolo. An infinite horizon optimal control problem for some switching systems. Discrete & Continuous Dynamical Systems - B, 2001, 1 (4) : 443-462. doi: 10.3934/dcdsb.2001.1.443
[3]

Thomas I. Seidman. Optimal control of a diffusion/reaction/switching system. Evolution Equations & Control Theory, 2013, 2 (4) : 723-731. doi: 10.3934/eect.2013.2.723
[4]

Shulin Qin, Gengsheng Wang, Huaiqiang Yu. On switching properties of time optimal controls for linear ODEs. Mathematical Control & Related Fields, 2021, 11 (2) : 329-351. doi: 10.3934/mcrf.2020039
[5]

Fabian Rüffler, Volker Mehrmann, Falk M. Hante. Optimal model switching for gas flow in pipe networks. Networks & Heterogeneous Media, 2018, 13 (4) : 641-661. doi: 10.3934/nhm.2018029
[6]

Gechun Liang, Wei Wei. Optimal switching at Poisson random intervention times. Discrete & Continuous Dynamical Systems - B, 2016, 21 (5) : 1483-1505. doi: 10.3934/dcdsb.2016008
[7]

Jingzhi Tie, Qing Zhang. Switching between a pair of stocks: An optimal trading rule. Mathematical Control & Related Fields, 2018, 8 (3&4) : 965-999. doi: 10.3934/mcrf.2018042
[8]

Lin Xu, Rongming Wang, Dingjun Yao. Optimal stochastic investment games under Markov regime switching market. Journal of Industrial & Management Optimization, 2014, 10 (3) : 795-815. doi: 10.3934/jimo.2014.10.795
[9]

Fabio Bagagiolo. Optimal control of finite horizon type for a multidimensional delayed switching system. Discrete & Continuous Dynamical Systems - B, 2005, 5 (2) : 239-264. doi: 10.3934/dcdsb.2005.5.239
[10]

Galina Kurina, Sahlar Meherrem. Decomposition of discrete linear-quadratic optimal control problems for switching systems. Conference Publications, 2015, 2015 (special) : 764-774. doi: 10.3934/proc.2015.0764
[11]

Fredi Tröltzsch, Daniel Wachsmuth. On the switching behavior of sparse optimal controls for the one-dimensional heat equation. Mathematical Control & Related Fields, 2018, 8 (1) : 135-153. doi: 10.3934/mcrf.2018006
[12]

Jiaqin Wei. Time-inconsistent optimal control problems with regime-switching. Mathematical Control & Related Fields, 2017, 7 (4) : 585-622. doi: 10.3934/mcrf.2017022
[13]

Wensheng Yin, Jinde Cao, Yong Ren. Inverse optimal control of regime-switching jump diffusions. Mathematical Control & Related Fields, 2021  doi: 10.3934/mcrf.2021034
[14]

Marcus Wagner. A direct method for the solution of an optimal control problem arising from image registration. Numerical Algebra, Control & Optimization, 2012, 2 (3) : 487-510. doi: 10.3934/naco.2012.2.487
[15]

Qiang Du, Jingyan Zhang. Asymptotic analysis of a diffuse interface relaxation to a nonlocal optimal partition problem. Discrete & Continuous Dynamical Systems, 2011, 29 (4) : 1443-1461. doi: 10.3934/dcds.2011.29.1443
[16]

Jie Yu, Qing Zhang. Optimal trend-following trading rules under a three-state regime switching model. Mathematical Control & Related Fields, 2012, 2 (1) : 81-100. doi: 10.3934/mcrf.2012.2.81
[17]

Ka Chun Cheung, Hailiang Yang. Optimal investment-consumption strategy in a discrete-time model with regime switching. Discrete & Continuous Dynamical Systems - B, 2007, 8 (2) : 315-332. doi: 10.3934/dcdsb.2007.8.315
[18]

Ming Yan, Hongtao Yang, Lei Zhang, Shuhua Zhang. Optimal investment-reinsurance policy with regime switching and value-at-risk constraint. Journal of Industrial & Management Optimization, 2020, 16 (5) : 2195-2211. doi: 10.3934/jimo.2019050
[19]

Lin Xu, Dingjun Yao, Gongpin Cheng. Optimal investment and dividend for an insurer under a Markov regime switching market with high gain tax. Journal of Industrial & Management Optimization, 2020, 16 (1) : 325-356. doi: 10.3934/jimo.2018154
[20]

Jiaqin Wei, Zhuo Jin, Hailiang Yang. Optimal dividend policy with liability constraint under a hidden Markov regime-switching model. Journal of Industrial & Management Optimization, 2019, 15 (4) : 1965-1993. doi: 10.3934/jimo.2018132

2020 Impact Factor: 1.801

Tools

Metrics

  • PDF downloads (210)
  • HTML views (1402)
  • Cited by (1)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences