Continuous and discrete embedded optimal control problems
and their application to the analysis of Clebsch optimal control
problems and mechanical systems

Anthony M. Bloch; Peter E. Crouch; Nikolaj Nordkvist

doi:10.3934/jgm.2013.5.1

Previous Article
Geometric dynamics on the automorphism group of principal bundles: Geodesic flows, dual pairs and chromomorphism groups
JGM Home
This Issue
Next Article

March 2013, 5(1): 1-38. doi: 10.3934/jgm.2013.5.1

Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems

Anthony M. Bloch ^1, , Peter E. Crouch ^2, and Nikolaj Nordkvist ^3,

1.	Department of Mathematics, University of Michigan, Ann Arbor, MI 48109, United States
2.	Department of Electrical Engineering, University of Hawai‘i at Mānoa, Honolulu, HI 96822
3.	Mathematics and Sciences Division, Leeward Community College, Pearl City, HI 96782, United States

Received July 2012 Revised February 2013 Published April 2013

Abstract
Related Papers

In this paper we define ``embedded optimal control problems" which prescribe parametrized families of well defined associated optimal control problems. We show that the extremal generating Hamiltonian equations for an embedded optimal control problem and any associated optimal control problem are simply related by a projection. Furthermore normal extremals project to normal extremals and similarly for abnormal extremals. An interesting class of embedded optimal control problems consists of Clebsch optimal control problems. We provide necessary conditions for a Clebsch optimal control problem to describe a variational problem and thereby a mechanical system. There may be many advantages to analyzing an embedded optimal control problem instead of a particular associated optimal control problem, for example the former being defined on a linear space and the latter on a nonlinear space. The continuous analysis is paralleled by a similar discrete analysis. We define a discrete embedded/Clebsch optimal control problem along with associated discrete optimal control problems and we show results that are analogous to the continuous results. We apply the theory, both in the continuous and the discrete setting, to two example systems: mechanical systems on matrix Lie groups and mechanical systems on $n$-spheres.

Keywords: continuous dynamics, mechanical systems, Optimal control, integrators., discrete dynamics, global analysis.

Mathematics Subject Classification: Primary: 37J15, 49K15, 49Q99, 49S05, 58Z05, 65L99, 70H30; Secondary: 34G2.

Citation: Anthony M. Bloch, Peter E. Crouch, Nikolaj Nordkvist. Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems. Journal of Geometric Mechanics, 2013, 5 (1) : 1-38. doi: 10.3934/jgm.2013.5.1

References:

[1]	A. M. Bloch, P. E. Crouch, D. D. Holm and J. E. Marsden, An optimal control formulation for inviscid incompressible ideal fluid flow, in "Proc. IEEE Conf. on Decision and Control," Sydney, Australia, (Dec. 2000), 1273-1279. doi: 10.1109/CDC.2000.912030. Google Scholar
[2]	A. M. Bloch, P. E. Crouch, J. E. Marsden and T. S. Ratiu, The symmetric representation of the rigid body equations and their discretization, Nonlinearity, 15 (2002), 1309-1341. doi: 10.1088/0951-7715/15/4/316. Google Scholar
[3]	A. M. Bloch, P. E. Crouch, J. E. Marsden and A. K. Sanyal, Optimal control and geodesics on quadratic matrix Lie groups, Foundations of Computational Mathematics, 8 (2008), 469-500. doi: 10.1007/s10208-008-9025-1. Google Scholar
[4]	A. M. Bloch, P. E. Crouch, N. Nordkvist and A. K. Sanyal, Embedded geodesic problems and optimal control for matrix Lie groups, Journal of Geometric Mechanics, 3 (2011), 197-223. doi: 10.3934/jgm.2011.3.197. Google Scholar
[5]	A. M. Bloch, P. E. Crouch and A. K. Sanyal, A variational problem on Stiefel manifolds, Nonlinearity, 19 (2006), 2247-2276. doi: 10.1088/0951-7715/19/10/002. Google Scholar
[6]	A. I Bobenko and Y. B. Suris, Discrete Lagrangian reduction, discrete Euler-Poincaré equations, and semidirect products, Letters in Mathematical Physics, 49 (1999), 79-93. doi: 10.1023/A:1007654605901. Google Scholar
[7]	V. G. Boltyanskii, "Optimal Control of Discrete Systems," John Wiley, New York, 1978. Google Scholar
[8]	N. Bou-Rabee and J. E. Marsden, Hamilton-Pontryagin integrators on Lie groups part I: Introduction and structure-preserving properties, Foundations of Computational Mathematics, 9 (2008), 197-219. doi: 10.1007/s10208-008-9030-4. Google Scholar
[9]	J. R. Cardoso and F. Silva Leite, The Moser-Veselov equation, Linear Algebra and its Applications, 360 (2003), 237-248. doi: 10.1016/S0024-3795(02)00450-0. Google Scholar
[10]	C. J. Cotter and D. D. Holm, Continuous and discrete Clebsch variational principles, Foundations of Computational Mathematics, 9 (2009), 221-242. doi: 10.1007/s10208-007-9022-9. Google Scholar
[11]	P. E. Crouch and R. Grossman, Numerical integration of ordinary differential equations on manifolds, Journal of Nonlinear Science, 3 (1993), 1-33. doi: 10.1007/BF02429858. Google Scholar
[12]	P. E. Crouch, N. Nordkvist and A. K. Sanyal, Optimal control and geodesics on matrix Lie groups, in "Proc. 9th Portuguese Conference on Automatic Control - CONTROLO'2010,'' Coimbra, Portugal, (Sep. 2010). Google Scholar
[13]	M. de León, D. Martín de Diego and A. Santamaría-Merino, Discrete variational integrators and optimal control theory, Advances in Computational Mathematics, 26 (2007), 251-268. doi: 10.1007/s10444-004-4093-5. Google Scholar
[14]	Y. N. Federov and V. V. Kozlov, Various aspects of n-dimensional rigid body dynamics, in "Dynamical Systems in Classical Mechanics," American Mathematical Society Translations, 168, Amer. Math. Soc., Providence, RI, (1995), 141-171. Google Scholar
[15]	F. Gay-Balmaz and T. S. Ratiu, Clebsch optimal control formulation in mechanics, Journal of Geometric Mechanics, 3 (2011), 41-79. doi: 10.3934/jgm.2011.3.41. Google Scholar
[16]	E. Hairer, C. Lubich and G. Wanner., "Geometric Numerical Integration," Springer Verlag, New York, 2002. Google Scholar
[17]	D. D. Holm, Riemannian optimal control formulation of incompressible ideal fluid flow,, preprint., (). Google Scholar
[18]	V. Jurdjevic, "Geometric Control Theory," Cambridge University Press, Cambridge, UK, 1997. Google Scholar
[19]	M. Kobilarov and J. E. Marsden, Discrete geometric optimal control on Lie groups, IEEE Transactions on Robotics, 27 (2011), 641-655. doi: 10.1007/s10208-011-9089-1. Google Scholar
[20]	T. Lee, M. Leok and N. H. McClamroch, A Lie group variational integrator for the attitude dynamics of a rigid body with applications to the 3D pendulum, in "Proc. IEEE Conf. on Control Applications," Toronto, Canada, (Aug. 2005), 962-967. Google Scholar
[21]	T. Lee, M. Leok and N. H. McClamroch, Lie group variational integrators for the full body problem, Comput. Methods Appl. Mech. Engrg., 196 (2007), 2907-2924. doi: 10.1016/j.cma.2007.01.017. Google Scholar
[22]	T. Lee, M. Leok and N. H. McClamroch, Lagrangian mechanics and variational integrators on two-spheres, International Journal for Numerical Methods in Engineering, 79 (2009), 1147-1174. doi: 10.1002/nme.2603. Google Scholar
[23]	S. V. Manakov, Note on the integration of Euler's equations of the dynamics of an n-dimensional rigid body, Functional Analysis and Its Applications, 10 (1976), 328-329. Google Scholar
[24]	J. E. Marsden, S. Pekarsky and S. Shkoller, Discrete Euler-Poincare and Lie-Poisson equations, Nonlinearity, 12 (1999), 1647-1662. doi: 10.1088/0951-7715/12/6/314. Google Scholar
[25]	J. E. Marsden and T. S. Ratiu, "Introduction to Mechanics and Symmetry," $2^{nd}$ edition, Texts in Applied Mathematics, 17, Springer Verlag, New York, 1999. Google Scholar
[26]	J. E. Marsden and M. West, Discrete mechanics and variational integrators, Acta Numerica, 10 (2001), 357-514. doi: 10.1017/S096249290100006X. Google Scholar
[27]	A. S. Mischenko and A. T. Fomenko, On the integration of the Euler equations on semisimple Lie algebras, Sov. Math. Dokl., 17 (1976), 1591-1593. Google Scholar
[28]	J. Moser and A. P. Veselov, Discrete versions of some classical integrable systems and factorization of matrix polynomials, Communications in Mathematical Physics, 139 (1991), 217-243. doi: 10.1007/BF02352494. Google Scholar
[29]	N. Nordkvist and A. K. Sanyal, A Lie group variational integrator for rigid body motion in $SE(3)$ with applications to underwater vehicles, in "IEEE Conf. on Decision and Control," Atlanta, GA, (Dec. 2010), 5414-5419. doi: 10.1109/CDC.2010.5717622. Google Scholar
[30]	J. Ortega and T. S. Ratiu, "Momentum Maps and Hamiltonian Reduction," Birkhäuser Verlag, Boston, 2004. Google Scholar
[31]	T. S. Ratiu, The motion of the free n-dimensional rigid body, Indiana University Mathematics Journal, 29 (1980), 609-629. doi: 10.1512/iumj.1980.29.29046. Google Scholar

show all references

References:

[1]	A. M. Bloch, P. E. Crouch, D. D. Holm and J. E. Marsden, An optimal control formulation for inviscid incompressible ideal fluid flow, in "Proc. IEEE Conf. on Decision and Control," Sydney, Australia, (Dec. 2000), 1273-1279. doi: 10.1109/CDC.2000.912030. Google Scholar
[2]	A. M. Bloch, P. E. Crouch, J. E. Marsden and T. S. Ratiu, The symmetric representation of the rigid body equations and their discretization, Nonlinearity, 15 (2002), 1309-1341. doi: 10.1088/0951-7715/15/4/316. Google Scholar
[3]	A. M. Bloch, P. E. Crouch, J. E. Marsden and A. K. Sanyal, Optimal control and geodesics on quadratic matrix Lie groups, Foundations of Computational Mathematics, 8 (2008), 469-500. doi: 10.1007/s10208-008-9025-1. Google Scholar
[4]	A. M. Bloch, P. E. Crouch, N. Nordkvist and A. K. Sanyal, Embedded geodesic problems and optimal control for matrix Lie groups, Journal of Geometric Mechanics, 3 (2011), 197-223. doi: 10.3934/jgm.2011.3.197. Google Scholar
[5]	A. M. Bloch, P. E. Crouch and A. K. Sanyal, A variational problem on Stiefel manifolds, Nonlinearity, 19 (2006), 2247-2276. doi: 10.1088/0951-7715/19/10/002. Google Scholar
[6]	A. I Bobenko and Y. B. Suris, Discrete Lagrangian reduction, discrete Euler-Poincaré equations, and semidirect products, Letters in Mathematical Physics, 49 (1999), 79-93. doi: 10.1023/A:1007654605901. Google Scholar
[7]	V. G. Boltyanskii, "Optimal Control of Discrete Systems," John Wiley, New York, 1978. Google Scholar
[8]	N. Bou-Rabee and J. E. Marsden, Hamilton-Pontryagin integrators on Lie groups part I: Introduction and structure-preserving properties, Foundations of Computational Mathematics, 9 (2008), 197-219. doi: 10.1007/s10208-008-9030-4. Google Scholar
[9]	J. R. Cardoso and F. Silva Leite, The Moser-Veselov equation, Linear Algebra and its Applications, 360 (2003), 237-248. doi: 10.1016/S0024-3795(02)00450-0. Google Scholar
[10]	C. J. Cotter and D. D. Holm, Continuous and discrete Clebsch variational principles, Foundations of Computational Mathematics, 9 (2009), 221-242. doi: 10.1007/s10208-007-9022-9. Google Scholar
[11]	P. E. Crouch and R. Grossman, Numerical integration of ordinary differential equations on manifolds, Journal of Nonlinear Science, 3 (1993), 1-33. doi: 10.1007/BF02429858. Google Scholar
[12]	P. E. Crouch, N. Nordkvist and A. K. Sanyal, Optimal control and geodesics on matrix Lie groups, in "Proc. 9th Portuguese Conference on Automatic Control - CONTROLO'2010,'' Coimbra, Portugal, (Sep. 2010). Google Scholar
[13]	M. de León, D. Martín de Diego and A. Santamaría-Merino, Discrete variational integrators and optimal control theory, Advances in Computational Mathematics, 26 (2007), 251-268. doi: 10.1007/s10444-004-4093-5. Google Scholar
[14]	Y. N. Federov and V. V. Kozlov, Various aspects of n-dimensional rigid body dynamics, in "Dynamical Systems in Classical Mechanics," American Mathematical Society Translations, 168, Amer. Math. Soc., Providence, RI, (1995), 141-171. Google Scholar
[15]	F. Gay-Balmaz and T. S. Ratiu, Clebsch optimal control formulation in mechanics, Journal of Geometric Mechanics, 3 (2011), 41-79. doi: 10.3934/jgm.2011.3.41. Google Scholar
[16]	E. Hairer, C. Lubich and G. Wanner., "Geometric Numerical Integration," Springer Verlag, New York, 2002. Google Scholar
[17]	D. D. Holm, Riemannian optimal control formulation of incompressible ideal fluid flow,, preprint., (). Google Scholar
[18]	V. Jurdjevic, "Geometric Control Theory," Cambridge University Press, Cambridge, UK, 1997. Google Scholar
[19]	M. Kobilarov and J. E. Marsden, Discrete geometric optimal control on Lie groups, IEEE Transactions on Robotics, 27 (2011), 641-655. doi: 10.1007/s10208-011-9089-1. Google Scholar
[20]	T. Lee, M. Leok and N. H. McClamroch, A Lie group variational integrator for the attitude dynamics of a rigid body with applications to the 3D pendulum, in "Proc. IEEE Conf. on Control Applications," Toronto, Canada, (Aug. 2005), 962-967. Google Scholar
[21]	T. Lee, M. Leok and N. H. McClamroch, Lie group variational integrators for the full body problem, Comput. Methods Appl. Mech. Engrg., 196 (2007), 2907-2924. doi: 10.1016/j.cma.2007.01.017. Google Scholar
[22]	T. Lee, M. Leok and N. H. McClamroch, Lagrangian mechanics and variational integrators on two-spheres, International Journal for Numerical Methods in Engineering, 79 (2009), 1147-1174. doi: 10.1002/nme.2603. Google Scholar
[23]	S. V. Manakov, Note on the integration of Euler's equations of the dynamics of an n-dimensional rigid body, Functional Analysis and Its Applications, 10 (1976), 328-329. Google Scholar
[24]	J. E. Marsden, S. Pekarsky and S. Shkoller, Discrete Euler-Poincare and Lie-Poisson equations, Nonlinearity, 12 (1999), 1647-1662. doi: 10.1088/0951-7715/12/6/314. Google Scholar
[25]	J. E. Marsden and T. S. Ratiu, "Introduction to Mechanics and Symmetry," $2^{nd}$ edition, Texts in Applied Mathematics, 17, Springer Verlag, New York, 1999. Google Scholar
[26]	J. E. Marsden and M. West, Discrete mechanics and variational integrators, Acta Numerica, 10 (2001), 357-514. doi: 10.1017/S096249290100006X. Google Scholar
[27]	A. S. Mischenko and A. T. Fomenko, On the integration of the Euler equations on semisimple Lie algebras, Sov. Math. Dokl., 17 (1976), 1591-1593. Google Scholar
[28]	J. Moser and A. P. Veselov, Discrete versions of some classical integrable systems and factorization of matrix polynomials, Communications in Mathematical Physics, 139 (1991), 217-243. doi: 10.1007/BF02352494. Google Scholar
[29]	N. Nordkvist and A. K. Sanyal, A Lie group variational integrator for rigid body motion in $SE(3)$ with applications to underwater vehicles, in "IEEE Conf. on Decision and Control," Atlanta, GA, (Dec. 2010), 5414-5419. doi: 10.1109/CDC.2010.5717622. Google Scholar
[30]	J. Ortega and T. S. Ratiu, "Momentum Maps and Hamiltonian Reduction," Birkhäuser Verlag, Boston, 2004. Google Scholar
[31]	T. S. Ratiu, The motion of the free n-dimensional rigid body, Indiana University Mathematics Journal, 29 (1980), 609-629. doi: 10.1512/iumj.1980.29.29046. Google Scholar

[1]	Cédric M. Campos, Sina Ober-Blöbaum, Emmanuel Trélat. High order variational integrators in the optimal control of mechanical systems. Discrete & Continuous Dynamical Systems, 2015, 35 (9) : 4193-4223. doi: 10.3934/dcds.2015.35.4193
[2]	Leonardo Colombo, Fernando Jiménez, David Martín de Diego. Variational integrators for mechanical control systems with symmetries. Journal of Computational Dynamics, 2015, 2 (2) : 193-225. doi: 10.3934/jcd.2015003
[3]	Viviana Alejandra Díaz, David Martín de Diego. Generalized variational calculus for continuous and discrete mechanical systems. Journal of Geometric Mechanics, 2018, 10 (4) : 373-410. doi: 10.3934/jgm.2018014
[4]	Javier Fernández, Sebastián Elías Graiff Zurita, Sergio Grillo. Erratum for "Error analysis of forced discrete mechanical systems". Journal of Geometric Mechanics, 2021, 13 (4) : 679-679. doi: 10.3934/jgm.2021030
[5]	Javier Fernández, Sebastián Elías Graiff Zurita, Sergio Grillo. Error analysis of forced discrete mechanical systems. Journal of Geometric Mechanics, 2021, 13 (4) : 533-606. doi: 10.3934/jgm.2021017
[6]	Matteo Focardi, Paolo Maria Mariano. Discrete dynamics of complex bodies with substructural dissipation: Variational integrators and convergence. Discrete & Continuous Dynamical Systems - B, 2009, 11 (1) : 109-130. doi: 10.3934/dcdsb.2009.11.109
[7]	Leonardo Colombo, David Martín de Diego. Optimal control of underactuated mechanical systems with symmetries. Conference Publications, 2013, 2013 (special) : 149-158. doi: 10.3934/proc.2013.2013.149
[8]	Paula A. González-Parra, Sunmi Lee, Leticia Velázquez, Carlos Castillo-Chavez. A note on the use of optimal control on a discrete time model of influenza dynamics. Mathematical Biosciences & Engineering, 2011, 8 (1) : 183-197. doi: 10.3934/mbe.2011.8.183
[9]	Jingang Zhao, Chi Zhang. Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning. Journal of Industrial & Management Optimization, 2021, 17 (3) : 1471-1483. doi: 10.3934/jimo.2020030
[10]	Kazeem Oare Okosun, Robert Smith?. Optimal control analysis of malaria-schistosomiasis co-infection dynamics. Mathematical Biosciences & Engineering, 2017, 14 (2) : 377-405. doi: 10.3934/mbe.2017024
[11]	André Nachbin. Discrete and continuous random water wave dynamics. Discrete & Continuous Dynamical Systems, 2010, 28 (4) : 1603-1633. doi: 10.3934/dcds.2010.28.1603
[12]	Hui Li, Manjun Ma. Corrigendum on “H. Li and M. Ma, global dynamics of a virus infection model with repulsive effect, Discrete and Continuous Dynamical Systems, Series B, 24(9) 4783-4797, 2019”. Discrete & Continuous Dynamical Systems - B, 2020, 25 (12) : 4925-4925. doi: 10.3934/dcdsb.2020299
[13]	Anthony M. Bloch, Rohit Gupta, Ilya V. Kolmanovsky. Neighboring extremal optimal control for mechanical systems on Riemannian manifolds. Journal of Geometric Mechanics, 2016, 8 (3) : 257-272. doi: 10.3934/jgm.2016007
[14]	Fasma Diele, Carmela Marangi. Positive symplectic integrators for predator-prey dynamics. Discrete & Continuous Dynamical Systems - B, 2018, 23 (7) : 2661-2678. doi: 10.3934/dcdsb.2017185
[15]	Anatoli F. Ivanov. On global dynamics in a multi-dimensional discrete map. Conference Publications, 2015, 2015 (special) : 652-659. doi: 10.3934/proc.2015.0652
[16]	Zaidong Zhan, Shuping Chen, Wei Wei. A unified theory of maximum principle for continuous and discrete time optimal control problems. Mathematical Control & Related Fields, 2012, 2 (2) : 195-215. doi: 10.3934/mcrf.2012.2.195
[17]	Alfonso Artigue. Discrete and continuous topological dynamics: Fields of cross sections and expansive flows. Discrete & Continuous Dynamical Systems, 2016, 36 (11) : 5911-5927. doi: 10.3934/dcds.2016059
[18]	S. Mohamad, K. Gopalsamy. Neuronal dynamics in time varying enviroments: Continuous and discrete time models. Discrete & Continuous Dynamical Systems, 2000, 6 (4) : 841-860. doi: 10.3934/dcds.2000.6.841
[19]	Folashade B. Agusto. Optimal control and cost-effectiveness analysis of a three age-structured transmission dynamics of chikungunya virus. Discrete & Continuous Dynamical Systems - B, 2017, 22 (3) : 687-715. doi: 10.3934/dcdsb.2017034
[20]	Qiying Hu, Wuyi Yue. Optimal control for resource allocation in discrete event systems. Journal of Industrial & Management Optimization, 2006, 2 (1) : 63-80. doi: 10.3934/jimo.2006.2.63

2020 Impact Factor: 0.857

American Institute of Mathematical Sciences

Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems

References:

References:

Tools

Metrics

Other articles
by authors

Tools

Metrics

Other articles
by authors

American Institute of Mathematical Sciences

Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems

References:

References:

Tools

Metrics

Other articlesby authors

Tools

Metrics

Other articlesby authors

Other articles
by authors

Other articles
by authors