2007, 2007(Special): 721-730. doi: 10.3934/proc.2007.2007.721

Global convergence of a memory gradient method with closed-form step size formula


UAE University, Department of Matematical Sciences, P.O. Box 17551, Al-Ain, United Arab Emirates

Received  September 2006 Revised  June 2007 Published  September 2007

The memory gradient method is used to solve large scale unconstrained optimization problems. We investigate a closed-form step size formula given by a finite number of iterates ofWeiszfeld’s algorithm to compute the step size for a memory gradient method. This formula can be classified as a no-line search procedure since no stopping criteria is involved to ensure convergence, unlike the classical line search procedures. We show the global convergence of the memory gradient method, under weaker conditions.
Citation: Nora Merabet. Global convergence of a memory gradient method with closed-form step size formula. Conference Publications, 2007, 2007 (Special) : 721-730. doi: 10.3934/proc.2007.2007.721

Sigve Hovda. Closed-form expression for the inverse of a class of tridiagonal matrices. Numerical Algebra, Control & Optimization, 2016, 6 (4) : 437-445. doi: 10.3934/naco.2016019


Jacinto Marabel Romo. A closed-form solution for outperformance options with stochastic correlation and stochastic volatility. Journal of Industrial & Management Optimization, 2015, 11 (4) : 1185-1209. doi: 10.3934/jimo.2015.11.1185


Azam Chaudhry, Rehana Naz. Closed-form solutions for the Lucas-Uzawa growth model with logarithmic utility preferences via the partial Hamiltonian approach. Discrete & Continuous Dynamical Systems - S, 2018, 11 (4) : 643-654. doi: 10.3934/dcdss.2018039


Yigui Ou, Yuanwen Liu. A memory gradient method based on the nonmonotone technique. Journal of Industrial & Management Optimization, 2017, 13 (2) : 857-872. doi: 10.3934/jimo.2016050


Yanfei Wang, Qinghua Ma. A gradient method for regularizing retrieval of aerosol particle size distribution function. Journal of Industrial & Management Optimization, 2009, 5 (1) : 115-126. doi: 10.3934/jimo.2009.5.115


Stefan Kindermann. Convergence of the gradient method for ill-posed problems. Inverse Problems & Imaging, 2017, 11 (4) : 703-720. doi: 10.3934/ipi.2017033


Feng Ma, Jiansheng Shu, Yaxiong Li, Jian Wu. The dual step size of the alternating direction method can be larger than 1.618 when one function is strongly convex. Journal of Industrial & Management Optimization, 2021, 17 (3) : 1173-1185. doi: 10.3934/jimo.2020016


C.Y. Wang, M.X. Li. Convergence property of the Fletcher-Reeves conjugate gradient method with errors. Journal of Industrial & Management Optimization, 2005, 1 (2) : 193-200. doi: 10.3934/jimo.2005.1.193


Yu-Ning Yang, Su Zhang. On linear convergence of projected gradient method for a class of affine rank minimization problems. Journal of Industrial & Management Optimization, 2016, 12 (4) : 1507-1519. doi: 10.3934/jimo.2016.12.1507


Yulan Lu, Minghui Song, Mingzhu Liu. Convergence rate and stability of the split-step theta method for stochastic differential equations with piecewise continuous arguments. Discrete & Continuous Dynamical Systems - B, 2019, 24 (2) : 695-717. doi: 10.3934/dcdsb.2018203


Minoru Murai, Waichiro Matsumoto, Shoji Yotsutani. Representation formula for the plane closed elastic curves. Conference Publications, 2013, 2013 (special) : 565-585. doi: 10.3934/proc.2013.2013.565


Yoonsang Lee, Bjorn Engquist. Variable step size multiscale methods for stiff and highly oscillatory dynamical systems. Discrete & Continuous Dynamical Systems, 2014, 34 (3) : 1079-1097. doi: 10.3934/dcds.2014.34.1079


Zhili Ge, Gang Qian, Deren Han. Global convergence of an inexact operator splitting method for monotone variational inequalities. Journal of Industrial & Management Optimization, 2011, 7 (4) : 1013-1026. doi: 10.3934/jimo.2011.7.1013


Liyan Qi, Xiantao Xiao, Liwei Zhang. On the global convergence of a parameter-adjusting Levenberg-Marquardt method. Numerical Algebra, Control & Optimization, 2015, 5 (1) : 25-36. doi: 10.3934/naco.2015.5.25


Gonglin Yuan, Zhan Wang, Pengyuan Li. Global convergence of a modified Broyden family method for nonconvex functions. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021164


Gaohang Yu, Lutai Guan, Guoyin Li. Global convergence of modified Polak-Ribière-Polyak conjugate gradient methods with sufficient descent property. Journal of Industrial & Management Optimization, 2008, 4 (3) : 565-579. doi: 10.3934/jimo.2008.4.565


Amal Attouchi, Eero Ruosteenoja. Gradient regularity for a singular parabolic equation in non-divergence form. Discrete & Continuous Dynamical Systems, 2020, 40 (10) : 5955-5972. doi: 10.3934/dcds.2020254


Changjun Yu, Lei Yuan, Shuxuan Su. A new gradient computational formula for optimal control problems with time-delay. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021076


Timoteo Carletti. The lagrange inversion formula on non--Archimedean fields, non--analytical form of differential and finite difference equations. Discrete & Continuous Dynamical Systems, 2003, 9 (4) : 835-858. doi: 10.3934/dcds.2003.9.835


Hui Liu, Yiming Long, Yuming Xiao. The existence of two non-contractible closed geodesics on every bumpy Finsler compact space form. Discrete & Continuous Dynamical Systems, 2018, 38 (8) : 3803-3829. doi: 10.3934/dcds.2018165

 Impact Factor: 


  • PDF downloads (30)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]