American Institute of Mathematical Sciences

Advanced
April  2008, 4(2): 227-246. doi: 10.3934/jimo.2008.4.227

Finite difference approximation for stochastic optimal stopping problems with delays

Mou-Hsiung Chang 1, , Tao Pang 2, and  Moustapha Pemy 3,

1. 

Mathematics Division, U. S. Army Research Office, P. O. Box 12211, RTP, NC 27709, United States
2. 

Department of Mathematics and Center for Research in Scientific Computation, North Carolina State University, Raleigh, NC 27695-8205, United States
3. 

Department of Mathematics, Towson University, 7800 York Road, Room 316, Towson, MD 21252-0001, United States

Received  March 2007 Revised  September 2007 Published  April 2008

This paper considers the computational issue of the optimal stopping problem for the stochastic functional differential equation treated in [6] The finite difference method developed by Barles and Souganidis [3] is used to obtain a numerical approximation for the viscosity solution of the infinite dimensional Hamilton-Jacobi-Bellman variational inequality (HJBVI) associated with the optimal stopping problem. The convergence results are then established.
Keywords: finite difference., optimal stopping, stochastic functional differential equations, stochastic control.
Mathematics Subject Classification: Primary: 60A09, 60H30; Secondary: 60G44, 90A1.
Citation: Mou-Hsiung Chang, Tao Pang, Moustapha Pemy. Finite difference approximation for stochastic optimal stopping problems with delays. Journal of Industrial and Management Optimization, 2008, 4 (2) : 227-246. doi: 10.3934/jimo.2008.4.227
[1]

Ștefana-Lucia Aniţa. Optimal control for stochastic differential equations and related Kolmogorov equations. Evolution Equations and Control Theory, 2022  doi: 10.3934/eect.2022023
[2]

Yongqiang Suo, Chenggui Yuan. Large deviations for neutral stochastic functional differential equations. Communications on Pure and Applied Analysis, 2020, 19 (4) : 2369-2384. doi: 10.3934/cpaa.2020103
[3]

Ishak Alia. Time-inconsistent stochastic optimal control problems: a backward stochastic partial differential equations approach. Mathematical Control and Related Fields, 2020, 10 (4) : 785-826. doi: 10.3934/mcrf.2020020
[4]

John A. D. Appleby, Xuerong Mao, Alexandra Rodkina. On stochastic stabilization of difference equations. Discrete and Continuous Dynamical Systems, 2006, 15 (3) : 843-857. doi: 10.3934/dcds.2006.15.843
[5]

Kai Liu. On regularity of stochastic convolutions of functional linear differential equations with memory. Discrete and Continuous Dynamical Systems - B, 2020, 25 (4) : 1279-1298. doi: 10.3934/dcdsb.2019220
[6]

Daoyi Xu, Yumei Huang, Zhiguo Yang. Existence theorems for periodic Markov process and stochastic functional differential equations. Discrete and Continuous Dynamical Systems, 2009, 24 (3) : 1005-1023. doi: 10.3934/dcds.2009.24.1005
[7]

Minghui Song, Liangjian Hu, Xuerong Mao, Liguo Zhang. Khasminskii-type theorems for stochastic functional differential equations. Discrete and Continuous Dynamical Systems - B, 2013, 18 (6) : 1697-1714. doi: 10.3934/dcdsb.2013.18.1697
[8]

Yuyun Zhao, Yi Zhang, Tao Xu, Ling Bai, Qian Zhang. pth moment exponential stability of hybrid stochastic functional differential equations by feedback control based on discrete-time state observations. Discrete and Continuous Dynamical Systems - B, 2017, 22 (1) : 209-226. doi: 10.3934/dcdsb.2017011
[9]

Jianhui Huang, Xun Li, Jiongmin Yong. A linear-quadratic optimal control problem for mean-field stochastic differential equations in infinite horizon. Mathematical Control and Related Fields, 2015, 5 (1) : 97-139. doi: 10.3934/mcrf.2015.5.97
[10]

Elena Braverman, Alexandra Rodkina. Stochastic difference equations with the Allee effect. Discrete and Continuous Dynamical Systems, 2016, 36 (11) : 5929-5949. doi: 10.3934/dcds.2016060
[11]

Min Yang, Guanggan Chen. Finite dimensional reducing and smooth approximating for a class of stochastic partial differential equations. Discrete and Continuous Dynamical Systems - B, 2020, 25 (4) : 1565-1581. doi: 10.3934/dcdsb.2019240
[12]

Viorel Barbu. Existence for nonlinear finite dimensional stochastic differential equations of subgradient type. Mathematical Control and Related Fields, 2018, 8 (3&4) : 501-508. doi: 10.3934/mcrf.2018020
[13]

Qi Lü, Xu Zhang. A concise introduction to control theory for stochastic partial differential equations. Mathematical Control and Related Fields, 2021  doi: 10.3934/mcrf.2021020
[14]

Zhenyu Lu, Junhao Hu, Xuerong Mao. Stabilisation by delay feedback control for highly nonlinear hybrid stochastic differential equations. Discrete and Continuous Dynamical Systems - B, 2019, 24 (8) : 4099-4116. doi: 10.3934/dcdsb.2019052
[15]

Wei Mao, Yanan Jiang, Liangjian Hu, Xuerong Mao. Stabilization by intermittent control for hybrid stochastic differential delay equations. Discrete and Continuous Dynamical Systems - B, 2022, 27 (1) : 569-581. doi: 10.3934/dcdsb.2021055
[16]

Fulvia Confortola, Elisa Mastrogiacomo. Feedback optimal control for stochastic Volterra equations with completely monotone kernels. Mathematical Control and Related Fields, 2015, 5 (2) : 191-235. doi: 10.3934/mcrf.2015.5.191
[17]

Yufeng Shi, Tianxiao Wang, Jiongmin Yong. Optimal control problems of forward-backward stochastic Volterra integral equations. Mathematical Control and Related Fields, 2015, 5 (3) : 613-649. doi: 10.3934/mcrf.2015.5.613
[18]

N. U. Ahmed. Weak solutions of stochastic reaction diffusion equations and their optimal control. Discrete and Continuous Dynamical Systems - S, 2018, 11 (6) : 1011-1029. doi: 10.3934/dcdss.2018059
[19]

Jiongmin Yong. Stochastic optimal control — A concise introduction. Mathematical Control and Related Fields, 2020  doi: 10.3934/mcrf.2020027
[20]

Alexandra Rodkina, Henri Schurz. On positivity and boundedness of solutions of nonlinear stochastic difference equations. Conference Publications, 2009, 2009 (Special) : 640-649. doi: 10.3934/proc.2009.2009.640

2020 Impact Factor: 1.801

Tools

Metrics

  • PDF downloads (118)
  • HTML views (0)
  • Cited by (4)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy