American Institute of Mathematical Sciences

Advanced
  • Previous Article
    Reliability optimization of component assignment problem for a multistate network in terms of minimal cuts
  • JIMO Home
  • This Issue
  • Next Article
    A differential equation method for solving box constrained variational inequality problems
January  2011, 7(1): 199-210. doi: 10.3934/jimo.2011.7.199

On the convergence rate of the inexact Levenberg-Marquardt method

Jinyan Fan 1, and  Jianyu Pan 2,

1. 

Department of Mathematics, Shanghai Jiao Tong University, Shanghai 200240
2. 

Department of Mathematics, East China Normal University, Shanghai 200062

Received  July 2010 Revised  November 2010 Published  January 2011

In this paper we study the convergence rate of the inexact Levenberg-Marquardt method for nonlinear equations. Under the local error bound condition which is weaker than nonsingularity, we derive an explicit formula of the convergence order of the inexact LM method, which is a continuous function with respect to not only the LM parameter but also the perturbation vector. The new formula includes many convergence rate results in the literature as its special cases.
Keywords: local error bound condition, convergence rate., Nonlinear equations, inexact Levenberg-Marquardt method.
Mathematics Subject Classification: 90C30, 65K05, 34A3.
Citation: Jinyan Fan, Jianyu Pan. On the convergence rate of the inexact Levenberg-Marquardt method. Journal of Industrial & Management Optimization, 2011, 7 (1) : 199-210. doi: 10.3934/jimo.2011.7.199
References:
[1]

Y. H. Dai and Y. X. Yuan, "Nonlinear Conjugate Gradient Methods,", Shanghai Science and Technology Publisher, (2000).   Google Scholar

[2]

H. Dan, N. Yamashita and M. Fukushima, Convergence properties of the inexact Levenberg-Marquardt method under local error bound,, Optimization Methods and Software, 17 (2002), 605.  doi: 10.1080/1055678021000049345.  Google Scholar

[3]

F. Facchinei and C. Kanzow, A nonsmooth inexact Newton method for the solution of large-scale nonlinear complementarity problems,, Mathematical Programming, 76 (1997), 493.  doi: 10.1007/BF02614395.  Google Scholar

[4]

J. Y. Fan and J. Y. Pan, Inexact Levenberg-Marquardt method for nonlinear equations,, Discrete Continuous Dynamical System-Series B, 4 (2004), 1223.  doi: 10.3934/dcdsb.2004.4.1223.  Google Scholar

[5]

J. Y. Fan and Y. X. Yuan, On the quadratic convergence of the Levenberg-Marquardt method without nonsingularity assumption,, Computing, 74 (2005), 23.  doi: 10.1007/s00607-004-0083-1.  Google Scholar

[6]

A. Fischera, P. K. Shuklaa and M. Wang, On the inexactness level of robust Levenberg-Marquardt methods,, Optimization, 59 (2010), 273.  doi: 10.1080/02331930801951256.  Google Scholar

[7]

K. Levenberg, A method for the solution of certain nonlinear problems in least squares,, Quart. Appl. Math., 2 (1944), 164.   Google Scholar

[8]

D. W. Marquardt, An algorithm for least-squares estimation of nonlinear inequalities,, SIAM J. Appl. Math., 11 (1963), 431.  doi: 10.1137/0111030.  Google Scholar

[9]

G. W. Stewart and J. G. Sun, "Matrix Perturbation Theory,", Academic Press, (1990).   Google Scholar

[10]

N. Yamashita and M. Fukushima, On the rate of convergence of the Levenberg-Marquardt method,, Computing, 15 (2001), 237.   Google Scholar

show all references

References:
[1]

Y. H. Dai and Y. X. Yuan, "Nonlinear Conjugate Gradient Methods,", Shanghai Science and Technology Publisher, (2000).   Google Scholar

[2]

H. Dan, N. Yamashita and M. Fukushima, Convergence properties of the inexact Levenberg-Marquardt method under local error bound,, Optimization Methods and Software, 17 (2002), 605.  doi: 10.1080/1055678021000049345.  Google Scholar

[3]

F. Facchinei and C. Kanzow, A nonsmooth inexact Newton method for the solution of large-scale nonlinear complementarity problems,, Mathematical Programming, 76 (1997), 493.  doi: 10.1007/BF02614395.  Google Scholar

[4]

J. Y. Fan and J. Y. Pan, Inexact Levenberg-Marquardt method for nonlinear equations,, Discrete Continuous Dynamical System-Series B, 4 (2004), 1223.  doi: 10.3934/dcdsb.2004.4.1223.  Google Scholar

[5]

J. Y. Fan and Y. X. Yuan, On the quadratic convergence of the Levenberg-Marquardt method without nonsingularity assumption,, Computing, 74 (2005), 23.  doi: 10.1007/s00607-004-0083-1.  Google Scholar

[6]

A. Fischera, P. K. Shuklaa and M. Wang, On the inexactness level of robust Levenberg-Marquardt methods,, Optimization, 59 (2010), 273.  doi: 10.1080/02331930801951256.  Google Scholar

[7]

K. Levenberg, A method for the solution of certain nonlinear problems in least squares,, Quart. Appl. Math., 2 (1944), 164.   Google Scholar

[8]

D. W. Marquardt, An algorithm for least-squares estimation of nonlinear inequalities,, SIAM J. Appl. Math., 11 (1963), 431.  doi: 10.1137/0111030.  Google Scholar

[9]

G. W. Stewart and J. G. Sun, "Matrix Perturbation Theory,", Academic Press, (1990).   Google Scholar

[10]

N. Yamashita and M. Fukushima, On the rate of convergence of the Levenberg-Marquardt method,, Computing, 15 (2001), 237.   Google Scholar

[1]

Haibo Cui, Haiyan Yin. Convergence rate of solutions toward stationary solutions to the isentropic micropolar fluid model in a half line. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020210
[2]

Deren Han, Zehui Jia, Yongzhong Song, David Z. W. Wang. An efficient projection method for nonlinear inverse problems with sparsity constraints. Inverse Problems & Imaging, 2016, 10 (3) : 689-709. doi: 10.3934/ipi.2016017
[3]

Zhiming Guo, Zhi-Chun Yang, Xingfu Zou. Existence and uniqueness of positive solution to a non-local differential equation with homogeneous Dirichlet boundary condition---A non-monotone case. Communications on Pure & Applied Analysis, 2012, 11 (5) : 1825-1838. doi: 10.3934/cpaa.2012.11.1825
[4]

Qiang Guo, Dong Liang. An adaptive wavelet method and its analysis for parabolic equations. Numerical Algebra, Control & Optimization, 2013, 3 (2) : 327-345. doi: 10.3934/naco.2013.3.327
[5]

Boris Kramer, John R. Singler. A POD projection method for large-scale algebraic Riccati equations. Numerical Algebra, Control & Optimization, 2016, 6 (4) : 413-435. doi: 10.3934/naco.2016018
[6]

Xiaoming Wang. Quasi-periodic solutions for a class of second order differential equations with a nonlinear damping term. Discrete & Continuous Dynamical Systems - S, 2017, 10 (3) : 543-556. doi: 10.3934/dcdss.2017027
[7]

Bin Pei, Yong Xu, Yuzhen Bai. Convergence of p-th mean in an averaging principle for stochastic partial differential equations driven by fractional Brownian motion. Discrete & Continuous Dynamical Systems - B, 2020, 25 (3) : 1141-1158. doi: 10.3934/dcdsb.2019213
[8]

Marion Darbas, Jérémy Heleine, Stephanie Lohrengel. Numerical resolution by the quasi-reversibility method of a data completion problem for Maxwell's equations. Inverse Problems & Imaging, 2020, 14 (6) : 1107-1133. doi: 10.3934/ipi.2020056
[9]

Jon Aaronson, Dalia Terhesiu. Local limit theorems for suspended semiflows. Discrete & Continuous Dynamical Systems - A, 2020, 40 (12) : 6575-6609. doi: 10.3934/dcds.2020294
[10]

Y. Latushkin, B. Layton. The optimal gap condition for invariant manifolds. Discrete & Continuous Dynamical Systems - A, 1999, 5 (2) : 233-268. doi: 10.3934/dcds.1999.5.233
[11]

Seung-Yeal Ha, Shi Jin. Local sensitivity analysis for the Cucker-Smale model with random inputs. Kinetic & Related Models, 2018, 11 (4) : 859-889. doi: 10.3934/krm.2018034
[12]

J. Frédéric Bonnans, Justina Gianatti, Francisco J. Silva. On the convergence of the Sakawa-Shindo algorithm in stochastic control. Mathematical Control & Related Fields, 2016, 6 (3) : 391-406. doi: 10.3934/mcrf.2016008
[13]

Fernando P. da Costa, João T. Pinto, Rafael Sasportes. On the convergence to critical scaling profiles in submonolayer deposition models. Kinetic & Related Models, 2018, 11 (6) : 1359-1376. doi: 10.3934/krm.2018053
[14]

Alberto Bressan, Carlotta Donadello. On the convergence of viscous approximations after shock interactions. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 29-48. doi: 10.3934/dcds.2009.23.29
[15]

Caifang Wang, Tie Zhou. The order of convergence for Landweber Scheme with $\alpha,\beta$-rule. Inverse Problems & Imaging, 2012, 6 (1) : 133-146. doi: 10.3934/ipi.2012.6.133
[16]

Armin Lechleiter, Tobias Rienmüller. Factorization method for the inverse Stokes problem. Inverse Problems & Imaging, 2013, 7 (4) : 1271-1293. doi: 10.3934/ipi.2013.7.1271
[17]

Yanqin Fang, Jihui Zhang. Multiplicity of solutions for the nonlinear Schrödinger-Maxwell system. Communications on Pure & Applied Analysis, 2011, 10 (4) : 1267-1279. doi: 10.3934/cpaa.2011.10.1267
[18]

Carlos Gutierrez, Nguyen Van Chau. A remark on an eigenvalue condition for the global injectivity of differentiable maps of $R^2$. Discrete & Continuous Dynamical Systems - A, 2007, 17 (2) : 397-402. doi: 10.3934/dcds.2007.17.397
[19]

Mansour Shrahili, Ravi Shanker Dubey, Ahmed Shafay. Inclusion of fading memory to Banister model of changes in physical condition. Discrete & Continuous Dynamical Systems - S, 2020, 13 (3) : 881-888. doi: 10.3934/dcdss.2020051
[20]

Olena Naboka. On synchronization of oscillations of two coupled Berger plates with nonlinear interior damping. Communications on Pure & Applied Analysis, 2009, 8 (6) : 1933-1956. doi: 10.3934/cpaa.2009.8.1933

2019 Impact Factor: 1.366

Tools

Metrics

  • PDF downloads (61)
  • HTML views (0)
  • Cited by (6)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences