
-
Previous Article
A stochastic model for water-vegetation systems and the effect of decreasing precipitation on semi-arid environments
- MBE Home
- This Issue
-
Next Article
Modelling chemistry and biology after implantation of a drug-eluting stent. Part Ⅱ: Cell proliferation
Optimal control problems with time delays: Two case studies in biomedicine
1. | Münster University of Applied Sciences, Department of Mechanical Engineering, Stegerwaldstr. 39, 48565 Steinfurt, Germany |
2. | University of Münster, Applied Mathematics: Institute of Analysis and Numerics, Einsteinstr. 62, 49143 Münster, Germany |
There exists an extensive literature on delay differential models in biology and biomedicine, but only a few papers study such models in the framework of optimal control theory. In this paper, we consider optimal control problems with multiple time delays in state and control variables and present two applications in biomedicine. After discussing the necessary optimality conditions for delayed optimal control problems with control-state constraints, we propose discretization methods by which the delayed optimal control problem is transformed into a large-scale nonlinear programming problem. The first case study is concerned with the delay differential model in [
References:
[1] |
B. Buonomo and M. Cerasuolo,
The effect of time delay in plant-pathogen interactions with host demography, Math. Biosciences and Engineering, 12 (2015), 473-490.
doi: 10.3934/mbe.2015.12.473. |
[2] |
C. Büskens,
Optimierungsmethoden und Sensitivitätsanalyse für optimale Steuerprozesse mit Steuer- und Zustands-Beschränkungen, PhD thesis, Institut für Numerische Mathematik, Westfälische Wilhelms-Universität Münster, Germany, 1998. |
[3] |
C. Büskens and H. Maurer,
SQP methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis and real-time control, J. Comput. Appl. Math., 120 (2000), 85-108.
doi: 10.1016/S0377-0427(00)00305-8. |
[4] |
C. Büskens and M. Gerdts, WORHP: Large-Scale Sparse Nonlinear Optimization Solver, http://www.worhp.de. |
[5] |
Q. Chai, R. Loxton, K. L. Teo and C. Yang,
A class of optimal state-delay control Problems, Nonlinear Analysis: Real World Applications, 14 (2013), 1536-1550.
doi: 10.1016/j.nonrwa.2012.10.017. |
[6] |
R. V. Culshaw and S. Ruan,
A delay-differential equation model of HIV infection of CD4+ T-cells, Mathematical Biosciences, 165 (2000), 27-39.
doi: 10.1016/S0025-5564(00)00006-7. |
[7] |
S. Eikenberry, S. Hews, J. D. Nagy and Y. Kuang,
The dynamics of a delay model of Hepatitis B virus infection with logistic hepatocyte growth, Mathematical Biosciences, 6 (2009), 283-299.
doi: 10.3934/mbe.2009.6.283. |
[8] |
R. Fourer, D. M. Gay and B. W. Kernighan,
AMPL: A Modeling Language for MathematicalProgramming, The Scientific Press, South San Francisco, California, 1993. |
[9] |
L. Göllmann, D. Kern and H. Maurer,
Optimal control problems with delays in state and control and mixed control-state constraints, Optimal Control Applications and Methods, 30 (2009), 341-365.
doi: 10.1002/oca.843. |
[10] |
L. Göllmann and H. Maurer,
Theory and applications of optimal control problems with multiple time-delays, Journal of Industrial and Management Optimization, 10 (2014), 413-441.
|
[11] |
T. Guinn,
Reduction of delayed optimal control problems to nondelayed problems, Journal of Optimization Theory and Applications, 18 (1976), 371-377.
doi: 10.1007/BF00933818. |
[12] |
R. F. Hartl, S. P. Sethi and R. G. Vickson,
A survey of the maximum principles for optimal control problems with state constraints, SIAM Review, 37 (1995), 181-218.
doi: 10.1137/1037043. |
[13] |
M. R. Hestenes,
Calculus of Variations and Optimal Control Theory, John Wiley, New York, 1966. |
[14] |
S. C. Huang,
Optimal Control problems with retardations and restricted phase coordinates, Journal of Optimization Theory and Applications, 3 (1969), 316-360.
doi: 10.1007/BF00931371. |
[15] |
J. Klamka, H. Maurer and A. Swierniak,
Local controllability and optimal control for a model of combined anticancer therapy with control delays, Mathematical Biosciences and Engineering, 14 (2017), 195-216.
doi: 10.3934/mbe.2017013. |
[16] |
Y. Kuang,
Delay Differential Equations with Applications in Population Dynamics, Academic Press, San Diego, 1993. |
[17] |
H. Maurer, C. Büskens, J.-H. R. Kim and Y. Kaya,
Optimization methods for the verification of second-order sufficient conditions for bang-bang controls, Optimal Control Methods and Applications, 26 (2005), 129-156.
doi: 10.1002/oca.756. |
[18] |
R. M. May,
Time-delay versus stability in population models with two and three tropic levels, Ecology, 54 (1973), 315-325.
|
[19] |
N. P. Osmolovskii and H. Maurer,
Applications to Regular and Bang-Bang Control: Second-Order Necessary and Sufficient Optimality Conditions in Calculus of Variations and Optimal Control, SIAM Advances in Design and Control, Vol. DC 24, SIAM Publications, Philadelphia, 2012.
doi: 10.1137/1.9781611972368. |
[20] |
L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko,
The Mathematical Theory of Optimal Processes, Translation by K. N. Trirogoff, Wiley, New York, 1962. |
[21] |
F. Rihan, D. H. Abdelrahman, F. Al-Maskari, F. Ibrahim and M. A. Abdeen, Delay differential model for tumour-immune-response with chemoimmunotherapy and optimal control.
Computational and Mathematical Methods in Medicine, Hindawi Publishing Corporation, Vol. 2014, Article ID 982978, (2014).
doi: 10.1155/2014/982978. |
[22] |
H. Schättler, U. Ledzewicz and H. Maurer,
Sufficient conditions for strong local optimality in optimal control problems with L2-type objectives and control constraints, Discrete Contin. Dyn. Syst. Ser. B, 19 (2014), 2657-2679.
doi: 10.3934/dcdsb.2014.19.2657. |
[23] |
C. Silva, H. Maurer and D.F.M. Torres,
Optimal control of a tuberculosis model with state and control delays, Mathematical Biosciences and Engineering, 14 (2017), 321-337.
doi: 10.3934/mbe.2017021. |
[24] |
C. T. Sreeramareddy, K. V. Panduru, J. Menten and J. V. den Ende,
Time delays in diagnosis of pulmonary tuberculosis: A systematic review of literature, BMC Infectious Diseases, 9 (2009), 91-100.
doi: 10.1186/1471-2334-9-91. |
[25] |
J. Stoer and R. Bulirsch,
Introduction ot Numerical Analysis, Third Edition, Texts in Applied Mathematics, Springer-Verlag, Berlin, 1990.
doi: 10.1007/978-3-662-22250-8. |
[26] |
D. G. Storla, S. Yimer and G. A. Bjune,
A systematic review in delay in the diagnosis and treatment of tuberculosis, BMC Public Health, 8 (2008), p15.
doi: 10.1186/1471-2458-8-15. |
[27] |
P. van den Driessche,
Some Epidemiological Models with Delays, Report DMS-679-IR, University of Victoria, Department of Mathematics, 1994. |
[28] |
A. Wächter and L. T. Biegler,
On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Mathematical Programming, 106 (2006), 25-57.
doi: 10.1007/s10107-004-0559-y. |
[29] |
H. Yang and J. Wei,
Global behaviour of a delayed viral kinetic model with general incidence rate, Discrete Contin. Dyn. Syst. Ser. B, 20 (2015), 1573-1582.
doi: 10.3934/dcdsb.2015.20.1573. |
show all references
References:
[1] |
B. Buonomo and M. Cerasuolo,
The effect of time delay in plant-pathogen interactions with host demography, Math. Biosciences and Engineering, 12 (2015), 473-490.
doi: 10.3934/mbe.2015.12.473. |
[2] |
C. Büskens,
Optimierungsmethoden und Sensitivitätsanalyse für optimale Steuerprozesse mit Steuer- und Zustands-Beschränkungen, PhD thesis, Institut für Numerische Mathematik, Westfälische Wilhelms-Universität Münster, Germany, 1998. |
[3] |
C. Büskens and H. Maurer,
SQP methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis and real-time control, J. Comput. Appl. Math., 120 (2000), 85-108.
doi: 10.1016/S0377-0427(00)00305-8. |
[4] |
C. Büskens and M. Gerdts, WORHP: Large-Scale Sparse Nonlinear Optimization Solver, http://www.worhp.de. |
[5] |
Q. Chai, R. Loxton, K. L. Teo and C. Yang,
A class of optimal state-delay control Problems, Nonlinear Analysis: Real World Applications, 14 (2013), 1536-1550.
doi: 10.1016/j.nonrwa.2012.10.017. |
[6] |
R. V. Culshaw and S. Ruan,
A delay-differential equation model of HIV infection of CD4+ T-cells, Mathematical Biosciences, 165 (2000), 27-39.
doi: 10.1016/S0025-5564(00)00006-7. |
[7] |
S. Eikenberry, S. Hews, J. D. Nagy and Y. Kuang,
The dynamics of a delay model of Hepatitis B virus infection with logistic hepatocyte growth, Mathematical Biosciences, 6 (2009), 283-299.
doi: 10.3934/mbe.2009.6.283. |
[8] |
R. Fourer, D. M. Gay and B. W. Kernighan,
AMPL: A Modeling Language for MathematicalProgramming, The Scientific Press, South San Francisco, California, 1993. |
[9] |
L. Göllmann, D. Kern and H. Maurer,
Optimal control problems with delays in state and control and mixed control-state constraints, Optimal Control Applications and Methods, 30 (2009), 341-365.
doi: 10.1002/oca.843. |
[10] |
L. Göllmann and H. Maurer,
Theory and applications of optimal control problems with multiple time-delays, Journal of Industrial and Management Optimization, 10 (2014), 413-441.
|
[11] |
T. Guinn,
Reduction of delayed optimal control problems to nondelayed problems, Journal of Optimization Theory and Applications, 18 (1976), 371-377.
doi: 10.1007/BF00933818. |
[12] |
R. F. Hartl, S. P. Sethi and R. G. Vickson,
A survey of the maximum principles for optimal control problems with state constraints, SIAM Review, 37 (1995), 181-218.
doi: 10.1137/1037043. |
[13] |
M. R. Hestenes,
Calculus of Variations and Optimal Control Theory, John Wiley, New York, 1966. |
[14] |
S. C. Huang,
Optimal Control problems with retardations and restricted phase coordinates, Journal of Optimization Theory and Applications, 3 (1969), 316-360.
doi: 10.1007/BF00931371. |
[15] |
J. Klamka, H. Maurer and A. Swierniak,
Local controllability and optimal control for a model of combined anticancer therapy with control delays, Mathematical Biosciences and Engineering, 14 (2017), 195-216.
doi: 10.3934/mbe.2017013. |
[16] |
Y. Kuang,
Delay Differential Equations with Applications in Population Dynamics, Academic Press, San Diego, 1993. |
[17] |
H. Maurer, C. Büskens, J.-H. R. Kim and Y. Kaya,
Optimization methods for the verification of second-order sufficient conditions for bang-bang controls, Optimal Control Methods and Applications, 26 (2005), 129-156.
doi: 10.1002/oca.756. |
[18] |
R. M. May,
Time-delay versus stability in population models with two and three tropic levels, Ecology, 54 (1973), 315-325.
|
[19] |
N. P. Osmolovskii and H. Maurer,
Applications to Regular and Bang-Bang Control: Second-Order Necessary and Sufficient Optimality Conditions in Calculus of Variations and Optimal Control, SIAM Advances in Design and Control, Vol. DC 24, SIAM Publications, Philadelphia, 2012.
doi: 10.1137/1.9781611972368. |
[20] |
L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko,
The Mathematical Theory of Optimal Processes, Translation by K. N. Trirogoff, Wiley, New York, 1962. |
[21] |
F. Rihan, D. H. Abdelrahman, F. Al-Maskari, F. Ibrahim and M. A. Abdeen, Delay differential model for tumour-immune-response with chemoimmunotherapy and optimal control.
Computational and Mathematical Methods in Medicine, Hindawi Publishing Corporation, Vol. 2014, Article ID 982978, (2014).
doi: 10.1155/2014/982978. |
[22] |
H. Schättler, U. Ledzewicz and H. Maurer,
Sufficient conditions for strong local optimality in optimal control problems with L2-type objectives and control constraints, Discrete Contin. Dyn. Syst. Ser. B, 19 (2014), 2657-2679.
doi: 10.3934/dcdsb.2014.19.2657. |
[23] |
C. Silva, H. Maurer and D.F.M. Torres,
Optimal control of a tuberculosis model with state and control delays, Mathematical Biosciences and Engineering, 14 (2017), 321-337.
doi: 10.3934/mbe.2017021. |
[24] |
C. T. Sreeramareddy, K. V. Panduru, J. Menten and J. V. den Ende,
Time delays in diagnosis of pulmonary tuberculosis: A systematic review of literature, BMC Infectious Diseases, 9 (2009), 91-100.
doi: 10.1186/1471-2334-9-91. |
[25] |
J. Stoer and R. Bulirsch,
Introduction ot Numerical Analysis, Third Edition, Texts in Applied Mathematics, Springer-Verlag, Berlin, 1990.
doi: 10.1007/978-3-662-22250-8. |
[26] |
D. G. Storla, S. Yimer and G. A. Bjune,
A systematic review in delay in the diagnosis and treatment of tuberculosis, BMC Public Health, 8 (2008), p15.
doi: 10.1186/1471-2458-8-15. |
[27] |
P. van den Driessche,
Some Epidemiological Models with Delays, Report DMS-679-IR, University of Victoria, Department of Mathematics, 1994. |
[28] |
A. Wächter and L. T. Biegler,
On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Mathematical Programming, 106 (2006), 25-57.
doi: 10.1007/s10107-004-0559-y. |
[29] |
H. Yang and J. Wei,
Global behaviour of a delayed viral kinetic model with general incidence rate, Discrete Contin. Dyn. Syst. Ser. B, 20 (2015), 1573-1582.
doi: 10.3934/dcdsb.2015.20.1573. |









Parameter | Description | Value |
final time | ||
|
state delay | |
|
control delay | |
|
control bounds | |
|
cell kill rate response | |
|
reciprocal carrying capacities of tumour and host cells | |
|
scaling parameters | |
|
drug decay rate | |
|
immune cell death rate | |
|
steepness of immune response | |
|
uninfected effector cell decrease rate | |
|
immune cell influx and decay rate resp. | |
|
cell growth rates | |
|
immune effector cell decrease rate | |
|
weights |
Parameter | Description | Value |
final time | ||
|
state delay | |
|
control delay | |
|
control bounds | |
|
cell kill rate response | |
|
reciprocal carrying capacities of tumour and host cells | |
|
scaling parameters | |
|
drug decay rate | |
|
immune cell death rate | |
|
steepness of immune response | |
|
uninfected effector cell decrease rate | |
|
immune cell influx and decay rate resp. | |
|
cell growth rates | |
|
immune effector cell decrease rate | |
|
weights |
[1] |
Ben Sheller, Domenico D'Alessandro. Analysis of a cancer dormancy model and control of immuno-therapy. Mathematical Biosciences & Engineering, 2015, 12 (5) : 1037-1053. doi: 10.3934/mbe.2015.12.1037 |
[2] |
Jerzy Klamka, Helmut Maurer, Andrzej Swierniak. Local controllability and optimal control for\newline a model of combined anticancer therapy with control delays. Mathematical Biosciences & Engineering, 2017, 14 (1) : 195-216. doi: 10.3934/mbe.2017013 |
[3] |
Laurenz Göllmann, Helmut Maurer. Theory and applications of optimal control problems with multiple time-delays. Journal of Industrial and Management Optimization, 2014, 10 (2) : 413-441. doi: 10.3934/jimo.2014.10.413 |
[4] |
Steffen Eikenberry, Sarah Hews, John D. Nagy, Yang Kuang. The dynamics of a delay model of hepatitis B virus infection with logistic hepatocyte growth. Mathematical Biosciences & Engineering, 2009, 6 (2) : 283-299. doi: 10.3934/mbe.2009.6.283 |
[5] |
Suxia Zhang, Xiaxia Xu. A mathematical model for hepatitis B with infection-age structure. Discrete and Continuous Dynamical Systems - B, 2016, 21 (4) : 1329-1346. doi: 10.3934/dcdsb.2016.21.1329 |
[6] |
Suxia Zhang, Hongbin Guo, Robert Smith?. Dynamical analysis for a hepatitis B transmission model with immigration and infection age. Mathematical Biosciences & Engineering, 2018, 15 (6) : 1291-1313. doi: 10.3934/mbe.2018060 |
[7] |
Bao-Zhu Guo, Li-Ming Cai. A note for the global stability of a delay differential equation of hepatitis B virus infection. Mathematical Biosciences & Engineering, 2011, 8 (3) : 689-694. doi: 10.3934/mbe.2011.8.689 |
[8] |
Marzena Dolbniak, Malgorzata Kardynska, Jaroslaw Smieja. Sensitivity of combined chemo-and antiangiogenic therapy results in different models describing cancer growth. Discrete and Continuous Dynamical Systems - B, 2018, 23 (1) : 145-160. doi: 10.3934/dcdsb.2018009 |
[9] |
Cristiana J. Silva, Helmut Maurer, Delfim F. M. Torres. Optimal control of a Tuberculosis model with state and control delays. Mathematical Biosciences & Engineering, 2017, 14 (1) : 321-337. doi: 10.3934/mbe.2017021 |
[10] |
Urszula Ledzewicz, Heinz Schättler. Drug resistance in cancer chemotherapy as an optimal control problem. Discrete and Continuous Dynamical Systems - B, 2006, 6 (1) : 129-150. doi: 10.3934/dcdsb.2006.6.129 |
[11] |
Zhaohua Gong, Chongyang Liu, Yujing Wang. Optimal control of switched systems with multiple time-delays and a cost on changing control. Journal of Industrial and Management Optimization, 2018, 14 (1) : 183-198. doi: 10.3934/jimo.2017042 |
[12] |
Ying Wu, Zhaohui Yuan, Yanpeng Wu. Optimal tracking control for networked control systems with random time delays and packet dropouts. Journal of Industrial and Management Optimization, 2015, 11 (4) : 1343-1354. doi: 10.3934/jimo.2015.11.1343 |
[13] |
Ting Kang, Qimin Zhang, Haiyan Wang. Optimal control of an avian influenza model with multiple time delays in state and control variables. Discrete and Continuous Dynamical Systems - B, 2021, 26 (8) : 4147-4171. doi: 10.3934/dcdsb.2020278 |
[14] |
Urszula Ledzewicz, Helen Moore. Optimal control applied to a generalized Michaelis-Menten model of CML therapy. Discrete and Continuous Dynamical Systems - B, 2018, 23 (1) : 331-346. doi: 10.3934/dcdsb.2018022 |
[15] |
Zhen-Zhen Tao, Bing Sun. Space-time spectral methods for a fourth-order parabolic optimal control problem in three control constraint cases. Discrete and Continuous Dynamical Systems - B, 2022 doi: 10.3934/dcdsb.2022080 |
[16] |
Jaouad Danane. Optimal control of viral infection model with saturated infection rate. Numerical Algebra, Control and Optimization, 2021, 11 (3) : 363-375. doi: 10.3934/naco.2020031 |
[17] |
Marita Holtmannspötter, Arnd Rösch, Boris Vexler. A priori error estimates for the space-time finite element discretization of an optimal control problem governed by a coupled linear PDE-ODE system. Mathematical Control and Related Fields, 2021, 11 (3) : 601-624. doi: 10.3934/mcrf.2021014 |
[18] |
Max Gunzburger, Sung-Dae Yang, Wenxiang Zhu. Analysis and discretization of an optimal control problem for the forced Fisher equation. Discrete and Continuous Dynamical Systems - B, 2007, 8 (3) : 569-587. doi: 10.3934/dcdsb.2007.8.569 |
[19] |
Rachid Ouifki, Gareth Witten. A model of HIV-1 infection with HAART therapy and intracellular delays. Discrete and Continuous Dynamical Systems - B, 2007, 8 (1) : 229-240. doi: 10.3934/dcdsb.2007.8.229 |
[20] |
Changjun Yu, Shuxuan Su, Yanqin Bai. On the optimal control problems with characteristic time control constraints. Journal of Industrial and Management Optimization, 2022, 18 (2) : 1305-1320. doi: 10.3934/jimo.2021021 |
2018 Impact Factor: 1.313
Tools
Metrics
Other articles
by authors
[Back to Top]