March  2019, 9(1): 101-112. doi: 10.3934/naco.2019008

Solving optimal control problem using Hermite wavelet

1. 

Department of Mathematics, Faculty of Mathematical Science and Statistics, University of Birjand, Birjand, Iran

2. 

Department of Applied Mathematics, Faculty of Mathematical Sciences, Ferdowsi University of Mashhad, Mashhad, Iran

* Corresponding author: Akram Kheirabadi

Received  May 2018 Revised  July 2018 Published  October 2018

In this paper, we derive the operational matrices of integration, derivative and production of Hermite wavelets and use a direct numerical method based on Hermite wavelet, for solving optimal control problems. The properties of Hermite polynomials are used for finding these matrices. First, we approximate the state and control variables by Hermite wavelets basis; then, the operational matrices is used to transfer the given problem into a linear system of algebraic equations. In fact, operational matrices of Hermite wavelet are employed to achieve a linear algebraic equation, in place of the dynamical system in terms of the unknown coefficients. The solution of this system gives us the solution of the original problem. Numerical examples with time varying and time invariant coefficient are given to demonstrate the applicability of these matrices.

Citation: Akram Kheirabadi, Asadollah Mahmoudzadeh Vaziri, Sohrab Effati. Solving optimal control problem using Hermite wavelet. Numerical Algebra, Control and Optimization, 2019, 9 (1) : 101-112. doi: 10.3934/naco.2019008
References:
[1]

A. A. Abu Haya, Solving Optimal Control Problem Via Chebyshev Wavelet, Masters thesis, Islamic University of Gaza, 2011.

[2]

A. AliM. A. Iqbal and S. T. Mohyud-Din, Hermite wavelets method for boundary value problems, International Journal of Modern Applied Physics, 3 (2013), 38-47. 

[3]

E. Babolian and F. Fattahzadeh, Numerical solution of differential equations by using Chebyshev wavelet operational matrix of integration, Applied Mathematics and Computation, 188 (2007), 417-426.  doi: 10.1016/j.amc.2006.10.008.

[4]

T. Basar and G. J. Olsder, Dynamic Noncooperative Game Theory, Academic Press, California, 1995.

[5]

M. Behroozifar and S. A. Yousefi, Numerical solution of delay differential equations via operational matrices of hybrid of block-pulse functions and Bernstein polynomials, Computational Methods for Differential Equations, 1 (2013), 78-95. 

[6]

C. F. Chen and C. H. Hsiao, Haar wavelet method for solving lumped and distributed-parameter systems, IEE Proceedings - Control Theory and Applications, 144 (1997), 87-94.  doi: 10.1049/ip-cta:19970702.

[7]

G. Elnagar, State-control spectral Chebyshev parameterization for linearly constrained quadratic optimal control problems, Journal of Computational and Applied Mathematics, 79 (1997), 19-40.  doi: 10.1016/S0377-0427(96)00134-3.

[8]

M. GhasemiE. Babolian and M. Tavassoli Kajani, Hybrid Fourier and block-pulse functions for applications in the calculus of variations, International Journal of Computer Mathematics, 83 (2006), 695-702.  doi: 10.1080/00207160601056016.

[9]

M. Ghasemi and M. Tavassoli Kajani, Numerical solution of time-varying delay systems by Chebyshev wavelets, Applied Mathematical Modelling, 35 (2011), 5235-5244.  doi: 10.1016/j.apm.2011.03.025.

[10]

J. S. Gu and W. S. Jiang, The Haar wavelets operational matrix of integration, International Journal of Systems Science, 27 (1996), 623-628.  doi: 10.1080/00207729608929258.

[11]

N. HaddadiY. Ordokhani and M. Razzaghi, Optimal control of delay systems by using a hybrid functions approximation, Journal of Optimization Theory and Applications, 153 (2012), 338-356.  doi: 10.1007/s10957-011-9932-1.

[12]

H. Hashemi Mehne and A. Hashemi Borzabadi, A numerical method for solving optimal control problems using state parametrization, Numerical Algorithms, 42 (2006), 165-169.  doi: 10.1007/s11075-006-9035-5.

[13]

H. C. Hsieh, Synthesis of adaptive control systems by function space methods, Advances in control systems, 2 (1965), 117-208.  doi: 10.1016/B978-1-4831-6712-1.50008-1.

[14]

C. Hwang and Y. P. Shih, Laguerre series direct method for variational problems, Journal of Optimization Theory and Applications, 39 (1983), 143-149.  doi: 10.1007/BF00934611.

[15]

C. Hwang and Y. P. Shih, Optimal control of delay systems via block pulse functions, Journal of Optimization Theory and Applications, 45 (1985), 101-112.  doi: 10.1007/BF00940816.

[16]

H. M. Jaddu, Numerical Methods for Solving Optimal Control Problems Using Chebyshev Polynomials, Ph. D thesis, School of Information Science, Japan Advanced Institute of Science and Technology, 1998.

[17]

B. KafashA. Delavarkhalafi and S. M. Karbassi, Application of variational iteration method for hamilton-jacobi-bellman equations, Applied Mathematical Modelling, 37 (2013), 3917-3928.  doi: 10.1016/j.apm.2012.08.013.

[18]

A. Majdalawi, An Iterative Technique for Solving Nonlinear Quadratic Optimal Control Problem Using Orthogonal Functions, Ph. D thesis, Alquds University, 2010.

[19]

E. R. Pinch, Optimal Control and the Calculus of Variations, Oxford University Press, 1995.

[20]

Z. RafieiB. Kafash and S. M. Karbassi, A new approach based on using Chebyshev wavelets for solving various optimal control problems, Computational and Applied Mathematics, 36 (2017), 1-14.  doi: 10.1007/s40314-017-0419-z.

[21]

M. Razzaghi, Solution of multi-delay systems via combined block-pulse functions and Legendre polynomials, Analele Stiintifice ale Universitatii Ovidius Constanta, 17 (2009), 223-232. 

[22]

M. Razzaghi and S. Yousefi, The Legendre wavelets operational matrix of integration, International Journal of Systems Science, 32 (2001), 495-502.  doi: 10.1080/00207720120227.

[23]

V. Rehbockt, K. L. Teo, L. S. Jenning and H. W. J. Lee, A survey of the control parametrization and control parametrization enhancing methods for constrained optimal control problem, in Progress in Optimization, Springer, Boston, (1999), 247-275. doi: 10.1007/978-1-4613-3285-5_13.

[24]

H. Saberi NikS. Effati and M. Shirazian, An approximate-analytical solution for the hamilton-jacobi-bellman equation via homotopy perturbation method, Mathematical and Computer Modelling, 36 (2012), 5614-5623.  doi: 10.1016/j.apm.2012.01.013.

[25]

H. R. SharifM. A. ValiM. Samavat and A. A. Gharavizi, A new algorithm for optimal control of time-delay systems, Applied Mathematical Sciences, 5 (2011), 595-606. 

[26]

X. T. Wang, Numerical solution of time-varying systems with a stretch by general Legendre wavelets, Applied Mathematics and Computation, 198 (2008), 613-620.  doi: 10.1016/j.amc.2007.08.058.

[27]

S. Yousefi and M. Razzaghi, Legendre wavelets method for the nonlinear volterra-fredholm integral equations, Mathematics and Computers in Simulation, 70 (2005), 1-8.  doi: 10.1016/j.matcom.2005.02.035.

show all references

References:
[1]

A. A. Abu Haya, Solving Optimal Control Problem Via Chebyshev Wavelet, Masters thesis, Islamic University of Gaza, 2011.

[2]

A. AliM. A. Iqbal and S. T. Mohyud-Din, Hermite wavelets method for boundary value problems, International Journal of Modern Applied Physics, 3 (2013), 38-47. 

[3]

E. Babolian and F. Fattahzadeh, Numerical solution of differential equations by using Chebyshev wavelet operational matrix of integration, Applied Mathematics and Computation, 188 (2007), 417-426.  doi: 10.1016/j.amc.2006.10.008.

[4]

T. Basar and G. J. Olsder, Dynamic Noncooperative Game Theory, Academic Press, California, 1995.

[5]

M. Behroozifar and S. A. Yousefi, Numerical solution of delay differential equations via operational matrices of hybrid of block-pulse functions and Bernstein polynomials, Computational Methods for Differential Equations, 1 (2013), 78-95. 

[6]

C. F. Chen and C. H. Hsiao, Haar wavelet method for solving lumped and distributed-parameter systems, IEE Proceedings - Control Theory and Applications, 144 (1997), 87-94.  doi: 10.1049/ip-cta:19970702.

[7]

G. Elnagar, State-control spectral Chebyshev parameterization for linearly constrained quadratic optimal control problems, Journal of Computational and Applied Mathematics, 79 (1997), 19-40.  doi: 10.1016/S0377-0427(96)00134-3.

[8]

M. GhasemiE. Babolian and M. Tavassoli Kajani, Hybrid Fourier and block-pulse functions for applications in the calculus of variations, International Journal of Computer Mathematics, 83 (2006), 695-702.  doi: 10.1080/00207160601056016.

[9]

M. Ghasemi and M. Tavassoli Kajani, Numerical solution of time-varying delay systems by Chebyshev wavelets, Applied Mathematical Modelling, 35 (2011), 5235-5244.  doi: 10.1016/j.apm.2011.03.025.

[10]

J. S. Gu and W. S. Jiang, The Haar wavelets operational matrix of integration, International Journal of Systems Science, 27 (1996), 623-628.  doi: 10.1080/00207729608929258.

[11]

N. HaddadiY. Ordokhani and M. Razzaghi, Optimal control of delay systems by using a hybrid functions approximation, Journal of Optimization Theory and Applications, 153 (2012), 338-356.  doi: 10.1007/s10957-011-9932-1.

[12]

H. Hashemi Mehne and A. Hashemi Borzabadi, A numerical method for solving optimal control problems using state parametrization, Numerical Algorithms, 42 (2006), 165-169.  doi: 10.1007/s11075-006-9035-5.

[13]

H. C. Hsieh, Synthesis of adaptive control systems by function space methods, Advances in control systems, 2 (1965), 117-208.  doi: 10.1016/B978-1-4831-6712-1.50008-1.

[14]

C. Hwang and Y. P. Shih, Laguerre series direct method for variational problems, Journal of Optimization Theory and Applications, 39 (1983), 143-149.  doi: 10.1007/BF00934611.

[15]

C. Hwang and Y. P. Shih, Optimal control of delay systems via block pulse functions, Journal of Optimization Theory and Applications, 45 (1985), 101-112.  doi: 10.1007/BF00940816.

[16]

H. M. Jaddu, Numerical Methods for Solving Optimal Control Problems Using Chebyshev Polynomials, Ph. D thesis, School of Information Science, Japan Advanced Institute of Science and Technology, 1998.

[17]

B. KafashA. Delavarkhalafi and S. M. Karbassi, Application of variational iteration method for hamilton-jacobi-bellman equations, Applied Mathematical Modelling, 37 (2013), 3917-3928.  doi: 10.1016/j.apm.2012.08.013.

[18]

A. Majdalawi, An Iterative Technique for Solving Nonlinear Quadratic Optimal Control Problem Using Orthogonal Functions, Ph. D thesis, Alquds University, 2010.

[19]

E. R. Pinch, Optimal Control and the Calculus of Variations, Oxford University Press, 1995.

[20]

Z. RafieiB. Kafash and S. M. Karbassi, A new approach based on using Chebyshev wavelets for solving various optimal control problems, Computational and Applied Mathematics, 36 (2017), 1-14.  doi: 10.1007/s40314-017-0419-z.

[21]

M. Razzaghi, Solution of multi-delay systems via combined block-pulse functions and Legendre polynomials, Analele Stiintifice ale Universitatii Ovidius Constanta, 17 (2009), 223-232. 

[22]

M. Razzaghi and S. Yousefi, The Legendre wavelets operational matrix of integration, International Journal of Systems Science, 32 (2001), 495-502.  doi: 10.1080/00207720120227.

[23]

V. Rehbockt, K. L. Teo, L. S. Jenning and H. W. J. Lee, A survey of the control parametrization and control parametrization enhancing methods for constrained optimal control problem, in Progress in Optimization, Springer, Boston, (1999), 247-275. doi: 10.1007/978-1-4613-3285-5_13.

[24]

H. Saberi NikS. Effati and M. Shirazian, An approximate-analytical solution for the hamilton-jacobi-bellman equation via homotopy perturbation method, Mathematical and Computer Modelling, 36 (2012), 5614-5623.  doi: 10.1016/j.apm.2012.01.013.

[25]

H. R. SharifM. A. ValiM. Samavat and A. A. Gharavizi, A new algorithm for optimal control of time-delay systems, Applied Mathematical Sciences, 5 (2011), 595-606. 

[26]

X. T. Wang, Numerical solution of time-varying systems with a stretch by general Legendre wavelets, Applied Mathematics and Computation, 198 (2008), 613-620.  doi: 10.1016/j.amc.2007.08.058.

[27]

S. Yousefi and M. Razzaghi, Legendre wavelets method for the nonlinear volterra-fredholm integral equations, Mathematics and Computers in Simulation, 70 (2005), 1-8.  doi: 10.1016/j.matcom.2005.02.035.

Figure 1.  Approximate (linestyle is -) and exact (linestyle is :) solution for x(t)
Figure 2.  Approximate (linestyle is -) and exact (linestyle :) solution for u(t)
Figure 3.  Approximate (linestyle -) and exact (linestyle :) solution for x(t)
Figure 4.  Approximate (linestyle -) and exact (linestyle :) solution for u(t)
Table 1.  Comparison of the optimal values of J (Example 4.1)
Exact value of J Kafash et al. [17] Saberi Nik et al. [24] Approximated solution via HW
0.1929092981 0.192914197 0.193415452 0.1929092981
Exact value of J Kafash et al. [17] Saberi Nik et al. [24] Approximated solution via HW
0.1929092981 0.192914197 0.193415452 0.1929092981
Table 2.  The exact and approximated values of x(t) and u(t) for Example 4.1
x(t) u(t)
Time Approximated solution via HW Exact solution Approximated solution via HW Exact solution
0.0 1.0000 1.0000 -0.3859 -0.3858
0.2 0.7594 0.7594 -0.2769 -0.2769
0.4 0.5799 0.5799 -0.1902 -0.1902
0.6 0.4472 0.4472 -0.1189 -0.1189
0.8 0.3505 0.3505 -0.0571 -0.0571
1 0.2820 0.2820 0.0000 0.0000
x(t) u(t)
Time Approximated solution via HW Exact solution Approximated solution via HW Exact solution
0.0 1.0000 1.0000 -0.3859 -0.3858
0.2 0.7594 0.7594 -0.2769 -0.2769
0.4 0.5799 0.5799 -0.1902 -0.1902
0.6 0.4472 0.4472 -0.1189 -0.1189
0.8 0.3505 0.3505 -0.0571 -0.0571
1 0.2820 0.2820 0.0000 0.0000
Table 3.  Comparison of the optimal values of J (Example 4.2)
Exact solution [19] Hashemi Mehne and Hashemi Borzabadi[12] Approximated solution via HW
6.1586 6.1748 6.1495
Exact solution [19] Hashemi Mehne and Hashemi Borzabadi[12] Approximated solution via HW
6.1586 6.1748 6.1495
Table 4.  The exact and approximated values of x(t) and u(t) for Example 4.2
x(t) u(t)
Time Approximated solution via HW Exact solution Approximated solution via HW Exact solution
0.0 0.0000 0.0000 1.1028 1.1029
0.2 0.2264 0.2265 1.4185 1.4188
0.4 0.4896 04897 1.9646 1.9648
0.6 0.8321 0.8324 2.8293 2.8293
0.8 1.3097 1.3100 4.1515 4.1526
1 2.0000 2.0000 6.1300 6.1493
x(t) u(t)
Time Approximated solution via HW Exact solution Approximated solution via HW Exact solution
0.0 0.0000 0.0000 1.1028 1.1029
0.2 0.2264 0.2265 1.4185 1.4188
0.4 0.4896 04897 1.9646 1.9648
0.6 0.8321 0.8324 2.8293 2.8293
0.8 1.3097 1.3100 4.1515 4.1526
1 2.0000 2.0000 6.1300 6.1493
Table 5.  Comparison between different methods for optimal value of J (Example 4.3)
Exact value Hsieh [13] Jaddu [16] Majdalawi [18] Our proposed method
0.06936094 0.0702 0.0693689 0.0693668896 0.0693688962
Exact value Hsieh [13] Jaddu [16] Majdalawi [18] Our proposed method
0.06936094 0.0702 0.0693689 0.0693668896 0.0693688962
Table 6.  The approximate and exact values of J (Example 4.4)
Exact value Approximated value via HW Error
0.16666666666 0.1666666666 0.4×10−14
Exact value Approximated value via HW Error
0.16666666666 0.1666666666 0.4×10−14
Table 7.  Comparison between different methods for optimal value of J (Example 4.5)
Elnagar [7] Jaddu [16] Abu Haya [1] Rafiei [20] Our method via HW
0.48427022 0.4842676003 0.4842678105 0.4842677529 0.4842676962
Elnagar [7] Jaddu [16] Abu Haya [1] Rafiei [20] Our method via HW
0.48427022 0.4842676003 0.4842678105 0.4842677529 0.4842676962
[1]

Akram Kheirabadi, Asadollah Mahmoudzadeh Vaziri, Sohrab Effati. Linear optimal control of time delay systems via Hermite wavelet. Numerical Algebra, Control and Optimization, 2020, 10 (2) : 143-156. doi: 10.3934/naco.2019044

[2]

Marcus Wagner. A direct method for the solution of an optimal control problem arising from image registration. Numerical Algebra, Control and Optimization, 2012, 2 (3) : 487-510. doi: 10.3934/naco.2012.2.487

[3]

Bin Han, Qun Mo. Analysis of optimal bivariate symmetric refinable Hermite interpolants. Communications on Pure and Applied Analysis, 2007, 6 (3) : 689-718. doi: 10.3934/cpaa.2007.6.689

[4]

Shujuan Lü, Zeting Liu, Zhaosheng Feng. Hermite spectral method for Long-Short wave equations. Discrete and Continuous Dynamical Systems - B, 2019, 24 (2) : 941-964. doi: 10.3934/dcdsb.2018255

[5]

Mohamed Aliane, Mohand Bentobache, Nacima Moussouni, Philippe Marthon. Direct method to solve linear-quadratic optimal control problems. Numerical Algebra, Control and Optimization, 2021, 11 (4) : 645-663. doi: 10.3934/naco.2021002

[6]

Meng Zhao, Aijie Cheng, Hong Wang. A preconditioned fast Hermite finite element method for space-fractional diffusion equations. Discrete and Continuous Dynamical Systems - B, 2017, 22 (9) : 3529-3545. doi: 10.3934/dcdsb.2017178

[7]

Mohammad Hadi Noori Skandari, Marzieh Habibli, Alireza Nazemi. A direct method based on the Clenshaw-Curtis formula for fractional optimal control problems. Mathematical Control and Related Fields, 2020, 10 (1) : 171-187. doi: 10.3934/mcrf.2019035

[8]

R. Wong, L. Zhang. Global asymptotics of Hermite polynomials via Riemann-Hilbert approach. Discrete and Continuous Dynamical Systems - B, 2007, 7 (3) : 661-682. doi: 10.3934/dcdsb.2007.7.661

[9]

Shu-Lin Lyu. On the Hermite--Hadamard inequality for convex functions of two variables. Numerical Algebra, Control and Optimization, 2014, 4 (1) : 1-8. doi: 10.3934/naco.2014.4.1

[10]

Irene I. Bouw, Sabine Kampf. Syndrome decoding for Hermite codes with a Sugiyama-type algorithm. Advances in Mathematics of Communications, 2012, 6 (4) : 419-442. doi: 10.3934/amc.2012.6.419

[11]

Tomasz Szostok. Inequalities of Hermite-Hadamard type for higher order convex functions, revisited. Communications on Pure and Applied Analysis, 2021, 20 (2) : 903-914. doi: 10.3934/cpaa.2020296

[12]

Antonella Falini, Francesca Mazzia, Cristiano Tamborrino. Spline based Hermite quasi-interpolation for univariate time series. Discrete and Continuous Dynamical Systems - S, 2022  doi: 10.3934/dcdss.2022039

[13]

Tijana Levajković, Hermann Mena, Amjad Tuffaha. The stochastic linear quadratic optimal control problem in Hilbert spaces: A polynomial chaos approach. Evolution Equations and Control Theory, 2016, 5 (1) : 105-134. doi: 10.3934/eect.2016.5.105

[14]

Iman Malmir. Caputo fractional derivative operational matrices of Legendre and Chebyshev wavelets in fractional delay optimal control. Numerical Algebra, Control and Optimization, 2022, 12 (2) : 395-426. doi: 10.3934/naco.2021013

[15]

Elena Goncharova, Maxim Staritsyn. Optimal control of dynamical systems with polynomial impulses. Discrete and Continuous Dynamical Systems, 2015, 35 (9) : 4367-4384. doi: 10.3934/dcds.2015.35.4367

[16]

Zhen-Zhen Tao, Bing Sun. Galerkin spectral method for elliptic optimal control problem with $L^2$-norm control constraint. Discrete and Continuous Dynamical Systems - B, 2022, 27 (8) : 4121-4141. doi: 10.3934/dcdsb.2021220

[17]

Hang-Chin Lai, Jin-Chirng Lee, Shuh-Jye Chern. A variational problem and optimal control. Journal of Industrial and Management Optimization, 2011, 7 (4) : 967-975. doi: 10.3934/jimo.2011.7.967

[18]

S. S. Dragomir, I. Gomm. Some new bounds for two mappings related to the Hermite-Hadamard inequality for convex functions. Numerical Algebra, Control and Optimization, 2012, 2 (2) : 271-278. doi: 10.3934/naco.2012.2.271

[19]

Anthony M. Bloch, Peter E. Crouch, Nikolaj Nordkvist, Amit K. Sanyal. Embedded geodesic problems and optimal control for matrix Lie groups. Journal of Geometric Mechanics, 2011, 3 (2) : 197-223. doi: 10.3934/jgm.2011.3.197

[20]

Qun Lin, Ryan Loxton, Kok Lay Teo. The control parameterization method for nonlinear optimal control: A survey. Journal of Industrial and Management Optimization, 2014, 10 (1) : 275-309. doi: 10.3934/jimo.2014.10.275

 Impact Factor: 

Metrics

  • PDF downloads (492)
  • HTML views (753)
  • Cited by (3)

[Back to Top]