American Institute of Mathematical Sciences

Advanced
December  2013, 5(4): 415-432. doi: 10.3934/jgm.2013.5.415

Regular discretizations in optimal control theory

Antonio Fernández 1, and  Pedro L. García 2,

1. 

Department of Applied Mathematics, University of Salamanca, Salamanca 37008
2. 

IUFFyM-USAL and Real Academia de Ciencias, Plaza de la Merced 1-4, 37008 Salamanca

Received  July 2013 Revised  November 2013 Published  December 2013

Given a regular optimal control problem with Lagrangian density $\mathcal{L} (t,x^\alpha,u^i)dt$ and constraints $\phi^\alpha\equiv \dot x^\alpha-f^\alpha(t,x^\beta,u^i)=0$, $1\le \alpha,\beta\le n$, $1\le i\le m$, we study the discretization defined for each pair $I_k=(k-1,k)$, $1\le k\le N$ by the functions: $$ \begin{aligned} L_{I_k}(x^\beta_{k-1},u^i_{k-1},x^\beta_k,u^i_k) = \mathcal{L} (t_{I_k},x^\alpha_{I_k},u^i_{I_k})h\\ \phi ^\alpha_{I_k}(x^\beta_{k-1},u^i_{k-1},x^\beta_k,u^i_k)=&\left(\frac{x^\alpha_{k}-x^\alpha_{k-1}}{h}-f^\alpha(t_{I_k},x^\beta_{I_k},u^i_{I_k}) \right)h \end{aligned} $$ where $t_k-t_{k-1}=h\in\mathbb{R}^+$ is fixed, and where: $$ \begin{aligned} t_{I_k}=&\epsilon t_{k-1}+(1-\epsilon) t_k=t_0+h(k-\epsilon)\\ x^\alpha_{I_k}=&\epsilon x^\alpha_{k-1}+(1-\epsilon)x^\alpha_k\\ u^i_{I_k}=&\epsilon u^i_{k-1}+(1-\epsilon)u^i_k \end{aligned}\quad 0\le \epsilon \le 1. $$ We prove that for $\epsilon\ne 0, 1$, the discrete Lagrange problems so defined are non singular in the sense of the discrete vakonomic mechanics admitting as infinitesimal symmetries the vector fields $D^i_k=\frac1{\epsilon h}\left(-\frac\epsilon{1-\epsilon}\right)^k\frac{\partial}{\partial u^i_k}$, $1\le i\le m$. The Noether invariants associated to these symmetries are used to construct the corresponding variational integrators. Finally, the theory is illustrated with two examples: the optimal regulator problem and the Heisenberg optimal control problem.
Keywords: variational integrators, Optimal control, discrete Noether invariants., regularity analysis.
Mathematics Subject Classification: 37J60, 37M15, 49J15, 65P1.
Citation: Antonio Fernández, Pedro L. García. Regular discretizations in optimal control theory. Journal of Geometric Mechanics, 2013, 5 (4) : 415-432. doi: 10.3934/jgm.2013.5.415
References:
[1]

M. Aldeen and F. Crusca, Quadratic cost function design for linear optimal control systems,, in TENCON '92., (1992), 958.  doi: 10.1109/TENCON.1992.271828.  Google Scholar

[2]

V. I. Arnol'd, V. V. Kozlov and A. I. Neĭshtadt, Dynamical Systems. III,, Encyclopaedia of Mathematical Sciences, (1988).  doi: 10.1007/978-3-642-61551-1.  Google Scholar

[3]

R. Benito and D. Martín de Diego, Discrete vakonomic mechanics,, J. Math. Phys., 46 (2005).  doi: 10.1063/1.2008214.  Google Scholar

[4]

A. M. Bloch, Nonholonomic Mechanics and Control,, Interdisciplinary Applied Mathematics, (2003).  doi: 10.1007/b97376.  Google Scholar

[5]

A. Fernández, P. L García and Ana G Sípols, Variational integrators in discrete time-dependent optimal control theory,, Rev. R. Acad. Cienc. Exactas Fís. Nat. Ser. A Math. RACSAM, 106 (2012), 173.  doi: 10.1007/s13398-011-0037-3.  Google Scholar

[6]

P. L. García, A. García and C. Rodrigo, Cartan forms for first order constrained variational problems,, J. Geom. Phys., 56 (2006), 571.  doi: 10.1016/j.geomphys.2005.04.002.  Google Scholar

[7]

P. L. García, A. Fernández and C. Rodrigo, Variational integrators for discrete Lagrange problems,, J. Geom. Mech., 2 (2010), 343.  doi: 10.3934/jgm.2010.2.343.  Google Scholar

[8]

V. Guibout and A. Bloch, A discrete maximum principle for solving optimal control problems,, in CDC. 43rd IEEE Conference on Decision and Control, (2004), 1806.  doi: 10.1109/CDC.2004.1430309.  Google Scholar

[9]

F. Jiménez and D. Martín de Diego, A geometric approach to discrete mechanics for optimal control theory,, in Proceedings of the IEEE Conference on Decision and Control, (2010), 5426.   Google Scholar

[10]

F. Jiménez, M. Kobilarov and Martín de Diego, Discrete variational optimal control,, accepted in Journal of Nonlinear Science, (2012).   Google Scholar

[11]

M. Kobilarov and J. E. Marsden, Discrete geometric optimal control on Lie groups,, IEEE Transactions on Robotics, 27 (2011), 641.  doi: 10.1109/TRO.2011.2139130.  Google Scholar

[12]

T. Lee, N. McClamroch and M. Leok, Optimal control of a rigid body using geometrically exact computations on SE(3),, in Proceedings of the IEEE Conference on Decision and Control, (2006), 2710.  doi: 10.1109/CDC.2006.376687.  Google Scholar

[13]

M. de León, D. Martín de Diego and A. Santamaría-Merino, Discrete variational integrators and optimal control theory,, Adv. Comput. Math., 26 (2006), 251.  doi: 10.1007/s10444-004-4093-5.  Google Scholar

[14]

M. de León, J. C. Marrero and D. Martín de Diego, Vakonomic mechanics versus non-holonomic mechanics: A unified geometrical approach,, J. Geom. Phys., 35 (2000), 126.  doi: 10.1016/S0393-0440(00)00004-8.  Google Scholar

[15]

M. Leok, Foundations of Computational Geometric Mechanics,, Ph.D. Thesis, (2004).   Google Scholar

[16]

J. E. Marsden, G. W. Patrick and S. Shkoller, Multisymplectic geometry, variational integrators, and nonlinear PDEs,, Comm. in Math. Phys., 199 (1998), 351.  doi: 10.1007/s002200050505.  Google Scholar

[17]

J. E. Marsden and M. West, Discrete mechanics and variational integrators,, Acta Numerica, 10 (2001), 317.  doi: 10.1017/S096249290100006X.  Google Scholar

[18]

J. Moser and A. P. Veselov, Discrete versions of some classical integrable systems and factorization of matrix polynomials,, Comm. Math. Phys., 139 (1991), 217.  doi: 10.1007/BF02352494.  Google Scholar

[19]

S. Ober-Blöbaum, O. Junge and J. E. Marsden, Discrete mechanics and optimal control: An analysis,, ESAIM Control Optim. Calc. Var., 17 (2011), 322.  doi: 10.1051/cocv/2010012.  Google Scholar

[20]

P. Piccione and D. V. Tausk, Lagrangian and Hamiltonian formalism for constrained variational problems,, Proc. Roy. Soc. Edinburgh Sect. A, 132 (2002), 1417.   Google Scholar

[21]

M. West, Variational Integrators,, Ph.D. Thesis, (2004).   Google Scholar

show all references

References:
[1]

M. Aldeen and F. Crusca, Quadratic cost function design for linear optimal control systems,, in TENCON '92., (1992), 958.  doi: 10.1109/TENCON.1992.271828.  Google Scholar

[2]

V. I. Arnol'd, V. V. Kozlov and A. I. Neĭshtadt, Dynamical Systems. III,, Encyclopaedia of Mathematical Sciences, (1988).  doi: 10.1007/978-3-642-61551-1.  Google Scholar

[3]

R. Benito and D. Martín de Diego, Discrete vakonomic mechanics,, J. Math. Phys., 46 (2005).  doi: 10.1063/1.2008214.  Google Scholar

[4]

A. M. Bloch, Nonholonomic Mechanics and Control,, Interdisciplinary Applied Mathematics, (2003).  doi: 10.1007/b97376.  Google Scholar

[5]

A. Fernández, P. L García and Ana G Sípols, Variational integrators in discrete time-dependent optimal control theory,, Rev. R. Acad. Cienc. Exactas Fís. Nat. Ser. A Math. RACSAM, 106 (2012), 173.  doi: 10.1007/s13398-011-0037-3.  Google Scholar

[6]

P. L. García, A. García and C. Rodrigo, Cartan forms for first order constrained variational problems,, J. Geom. Phys., 56 (2006), 571.  doi: 10.1016/j.geomphys.2005.04.002.  Google Scholar

[7]

P. L. García, A. Fernández and C. Rodrigo, Variational integrators for discrete Lagrange problems,, J. Geom. Mech., 2 (2010), 343.  doi: 10.3934/jgm.2010.2.343.  Google Scholar

[8]

V. Guibout and A. Bloch, A discrete maximum principle for solving optimal control problems,, in CDC. 43rd IEEE Conference on Decision and Control, (2004), 1806.  doi: 10.1109/CDC.2004.1430309.  Google Scholar

[9]

F. Jiménez and D. Martín de Diego, A geometric approach to discrete mechanics for optimal control theory,, in Proceedings of the IEEE Conference on Decision and Control, (2010), 5426.   Google Scholar

[10]

F. Jiménez, M. Kobilarov and Martín de Diego, Discrete variational optimal control,, accepted in Journal of Nonlinear Science, (2012).   Google Scholar

[11]

M. Kobilarov and J. E. Marsden, Discrete geometric optimal control on Lie groups,, IEEE Transactions on Robotics, 27 (2011), 641.  doi: 10.1109/TRO.2011.2139130.  Google Scholar

[12]

T. Lee, N. McClamroch and M. Leok, Optimal control of a rigid body using geometrically exact computations on SE(3),, in Proceedings of the IEEE Conference on Decision and Control, (2006), 2710.  doi: 10.1109/CDC.2006.376687.  Google Scholar

[13]

M. de León, D. Martín de Diego and A. Santamaría-Merino, Discrete variational integrators and optimal control theory,, Adv. Comput. Math., 26 (2006), 251.  doi: 10.1007/s10444-004-4093-5.  Google Scholar

[14]

M. de León, J. C. Marrero and D. Martín de Diego, Vakonomic mechanics versus non-holonomic mechanics: A unified geometrical approach,, J. Geom. Phys., 35 (2000), 126.  doi: 10.1016/S0393-0440(00)00004-8.  Google Scholar

[15]

M. Leok, Foundations of Computational Geometric Mechanics,, Ph.D. Thesis, (2004).   Google Scholar

[16]

J. E. Marsden, G. W. Patrick and S. Shkoller, Multisymplectic geometry, variational integrators, and nonlinear PDEs,, Comm. in Math. Phys., 199 (1998), 351.  doi: 10.1007/s002200050505.  Google Scholar

[17]

J. E. Marsden and M. West, Discrete mechanics and variational integrators,, Acta Numerica, 10 (2001), 317.  doi: 10.1017/S096249290100006X.  Google Scholar

[18]

J. Moser and A. P. Veselov, Discrete versions of some classical integrable systems and factorization of matrix polynomials,, Comm. Math. Phys., 139 (1991), 217.  doi: 10.1007/BF02352494.  Google Scholar

[19]

S. Ober-Blöbaum, O. Junge and J. E. Marsden, Discrete mechanics and optimal control: An analysis,, ESAIM Control Optim. Calc. Var., 17 (2011), 322.  doi: 10.1051/cocv/2010012.  Google Scholar

[20]

P. Piccione and D. V. Tausk, Lagrangian and Hamiltonian formalism for constrained variational problems,, Proc. Roy. Soc. Edinburgh Sect. A, 132 (2002), 1417.   Google Scholar

[21]

M. West, Variational Integrators,, Ph.D. Thesis, (2004).   Google Scholar

[1]

Paula A. González-Parra, Sunmi Lee, Leticia Velázquez, Carlos Castillo-Chavez. A note on the use of optimal control on a discrete time model of influenza dynamics. Mathematical Biosciences & Engineering, 2011, 8 (1) : 183-197. doi: 10.3934/mbe.2011.8.183
[2]

Diana Keller. Optimal control of a linear stochastic Schrödinger equation. Conference Publications, 2013, 2013 (special) : 437-446. doi: 10.3934/proc.2013.2013.437
[3]

Luke Finlay, Vladimir Gaitsgory, Ivan Lebedev. Linear programming solutions of periodic optimization problems: approximation of the optimal control. Journal of Industrial & Management Optimization, 2007, 3 (2) : 399-413. doi: 10.3934/jimo.2007.3.399
[4]

Xiaohong Li, Mingxin Sun, Zhaohua Gong, Enmin Feng. Multistage optimal control for microbial fed-batch fermentation process. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021040
[5]

John T. Betts, Stephen Campbell, Claire Digirolamo. Examination of solving optimal control problems with delays using GPOPS-Ⅱ. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 283-305. doi: 10.3934/naco.2020026
[6]

Shanjian Tang, Fu Zhang. Path-dependent optimal stochastic control and viscosity solution of associated Bellman equations. Discrete & Continuous Dynamical Systems - A, 2015, 35 (11) : 5521-5553. doi: 10.3934/dcds.2015.35.5521
[7]

Sergi Simon. Linearised higher variational equations. Discrete & Continuous Dynamical Systems - A, 2014, 34 (11) : 4827-4854. doi: 10.3934/dcds.2014.34.4827
[8]

Xue-Ping Luo, Yi-Bin Xiao, Wei Li. Strict feasibility of variational inclusion problems in reflexive Banach spaces. Journal of Industrial & Management Optimization, 2020, 16 (5) : 2495-2502. doi: 10.3934/jimo.2019065
[9]

Alexandre B. Simas, Fábio J. Valentim. $W$-Sobolev spaces: Higher order and regularity. Communications on Pure & Applied Analysis, 2015, 14 (2) : 597-607. doi: 10.3934/cpaa.2015.14.597
[10]

Jan Prüss, Laurent Pujo-Menjouet, G.F. Webb, Rico Zacher. Analysis of a model for the dynamics of prions. Discrete & Continuous Dynamical Systems - B, 2006, 6 (1) : 225-235. doi: 10.3934/dcdsb.2006.6.225
[11]

Yves Dumont, Frederic Chiroleu. Vector control for the Chikungunya disease. Mathematical Biosciences & Engineering, 2010, 7 (2) : 313-345. doi: 10.3934/mbe.2010.7.313
[12]

Chin-Chin Wu. Existence of traveling wavefront for discrete bistable competition model. Discrete & Continuous Dynamical Systems - B, 2011, 16 (3) : 973-984. doi: 10.3934/dcdsb.2011.16.973
[13]

Matthias Erbar, Jan Maas. Gradient flow structures for discrete porous medium equations. Discrete & Continuous Dynamical Systems - A, 2014, 34 (4) : 1355-1374. doi: 10.3934/dcds.2014.34.1355
[14]

M. R. S. Kulenović, J. Marcotte, O. Merino. Properties of basins of attraction for planar discrete cooperative maps. Discrete & Continuous Dynamical Systems - B, 2021, 26 (5) : 2721-2737. doi: 10.3934/dcdsb.2020202
[15]

Philippe G. Lefloch, Cristinel Mardare, Sorin Mardare. Isometric immersions into the Minkowski spacetime for Lorentzian manifolds with limited regularity. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 341-365. doi: 10.3934/dcds.2009.23.341
[16]

Y. Latushkin, B. Layton. The optimal gap condition for invariant manifolds. Discrete & Continuous Dynamical Systems - A, 1999, 5 (2) : 233-268. doi: 10.3934/dcds.1999.5.233
[17]

Sohana Jahan. Discriminant analysis of regularized multidimensional scaling. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 255-267. doi: 10.3934/naco.2020024
[18]

Ronald E. Mickens. Positivity preserving discrete model for the coupled ODE's modeling glycolysis. Conference Publications, 2003, 2003 (Special) : 623-629. doi: 10.3934/proc.2003.2003.623
[19]

J. Frédéric Bonnans, Justina Gianatti, Francisco J. Silva. On the convergence of the Sakawa-Shindo algorithm in stochastic control. Mathematical Control & Related Fields, 2016, 6 (3) : 391-406. doi: 10.3934/mcrf.2016008
[20]

Martin Bohner, Sabrina Streipert. Optimal harvesting policy for the Beverton--Holt model. Mathematical Biosciences & Engineering, 2016, 13 (4) : 673-695. doi: 10.3934/mbe.2016014

2019 Impact Factor: 0.649

Tools

Metrics

  • PDF downloads (27)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences