American Institute of Mathematical Sciences

Advanced
  • Previous Article
    Complete solutions and triality theory to a nonconvex optimization problem with double-well potential in $\mathbb{R}^n $
  • NACO Home
  • This Issue
  • Next Article
    Linearized alternating direction method of multipliers with Gaussian back substitution for separable convex programming
2013, 3(2): 261-270. doi: 10.3934/naco.2013.3.261

The stationary iterations revisited

Xuzhou Chen 1, , Xinghua Shi 2, and  Yimin Wei 3,

1. 

Department of Computer Science, Fitchburg State University, Fitchburg, MA 01420, United States
2. 

Institute of Mathematics, School of Mathematical Sciences, Fudan University, Shanghai 200433, China
3. 

School of Mathematical Sciences and Shanghai Key Laboratory of Contemporary Applied Mathematics, Fudan University, Shanghai 200433, China

Received  February 2012 Revised  January 2013 Published  April 2013

In this paper, we first present a necessary and sufficient conditions for the weakly and strongly convergence of the general stationary iterations $x^{(k+1)} = T x^{(k)} +c$ with initial iteration matrix $T$ and vectors $c$ and $x^{(0)}$. Then we apply these general results and present convergence conditions for the stationary iterations for solving singular linear system $A x = b$. We show that our convergence conditions are weaker and more general than the known results.
Keywords: Stationary iterations, Picard iterations, quotient convergence, singular linear systems, matrix splitting.
Mathematics Subject Classification: Primary: 65F10, 65F15; Secondary: 15A0.
Citation: Xuzhou Chen, Xinghua Shi, Yimin Wei. The stationary iterations revisited. Numerical Algebra, Control & Optimization, 2013, 3 (2) : 261-270. doi: 10.3934/naco.2013.3.261
References:
[1]

A. Berman and R. Plemmons, "Nonnegative Matrices in Mathematical Science," Academic Press, New York, 1979, SIAM, Philadelphia, 1994. Google Scholar

[2]

P. Bochev and R. B. Lehoucq, On the finite element solution of the pure Neumann problem, SIAM Review, 47 (2005), 50-66. doi: 10.1137/S0036144503426074.  Google Scholar

[3]

S. Campbell and C. Meyer, "Generalized Inverses of Linear Transformations," Pitman, London, 1979; Dover Publications, 1991; SIAM, Philadelphia, 2008.  Google Scholar

[4]

Z. Cao, On the convergence of iterative methods for solving singular linear systems, Journal of Computational and Applied Mathematics, 145 (2002), 1-9. doi: 10.1016/S0377-0427(01)00531-3.  Google Scholar

[5]

Z. Cao, On the convergence of general stationary linear iterative methods for singular linear systems, SIAM Journal on Matrix Analysis and Applications, 29 (2008), 1382-1388. doi: 10.1137/060671243.  Google Scholar

[6]

X. Chen and R. E. Hartwig, The Picard iteration and its application, Linear and Multilinear Algebra, 54 (2006), 329-341. doi: 10.1080/03081080500209703.  Google Scholar

[7]

X. Cui, Y. Wei and N. Zhang, Quotient convergence and multi-splitting methods for solving singular linear equations, Calcolo, 44 (2007), 21-31. doi: 10.1007/s10092-007-0127-y.  Google Scholar

[8]

M. Eiermann, I. Marek and W. Niethammer, On the solution of singular linear systems of algebraic equations by semi-iterative methods, Numerische Mathematik, 53 (1988), 265-283. doi: 10.1007/BF01404464.  Google Scholar

[9]

A. Frommer, R. Nabben and D. Szyld, Convergence of stationary iterative methods for Hermitian semidefinite linear systems and applications to Schwarz methods, SIAM Journal on Matrix Analysis and Applications, 30 (2008), 925-938. doi: 2009m:65055.  Google Scholar

[10]

F. R. Gantmacher, "The Theory of Matrices," Chelsea, New York, 1 (1960).  Google Scholar

[11]

N. Higham and P. Knight, Finite precision behavior of stationary iteration for solving singular systems, Linear Algebra and Its Applications, 192 (1993), 165-186. doi: 10.1016/0024-3795(93)90242-G.  Google Scholar

[12]

H. Keller, On the solution of singular and semi-definite linear systems by iteration, SIAM Journal on Numerical Analysis, 2 (1965), 281-290. Google Scholar

[13]

Y. Lee, J. Wu and L. Zikatanov, On the convergence of iterative methods for semidefinite linear systems, SIAM Journal on Matrix Analysis and Applications, 28 (2006), 634-641. doi: 10.1137/050644197.  Google Scholar

[14]

L. Lin, Y. Wei, C. Woo and J. Zhou, On the convergence of splittings for semidefinite linear systems, Linear Algebra and its Applications, 429 (2008), 2555-2566. doi: 10.1016/j.laa.2007.12.019.  Google Scholar

[15]

L. Lin, Y. Wei and N. Zhang, Convergence and quotient convergence of iterative methods for solving singular linear equations with index one, Linear Algebra and its Applications, 430 (2009), 1665-1674. doi: 10.1016/j.laa.2008.06.019.  Google Scholar

[16]

G. I. Marchuk and Y. Kuznetzov, "Iterative Methods and Quadratic Functionals," Science Press, Norvosibirsk, in Russian, 1972. Google Scholar

[17]

M. Neumann, Subproper splitting for rectangular matrices, Linear Algebra and its Applications, 14 (1976), 41-51. doi: 10.1016/0024-3795(76)90062-8.  Google Scholar

[18]

Y. Song, Semiconvergence of nonnegative splittings for singular matrices, Numerische Mathematik, 85 (2000), 109-127. doi: 10.1007/s002110050479.  Google Scholar

[19]

G. Wang, Y. Wei, and S. Qiao, "Generalized Inverses: Theory and Computations," Science Press, Beijing, 2004. Google Scholar

[20]

N. Zhang and Y. Wei, On the convergence of general stationary iterative methods for range-Hermitian singular linear systems, Numerical Linear Algebra with Applications, 17 (2010), 139-154. doi: 10.1002/nla.663.  Google Scholar

show all references

References:
[1]

A. Berman and R. Plemmons, "Nonnegative Matrices in Mathematical Science," Academic Press, New York, 1979, SIAM, Philadelphia, 1994. Google Scholar

[2]

P. Bochev and R. B. Lehoucq, On the finite element solution of the pure Neumann problem, SIAM Review, 47 (2005), 50-66. doi: 10.1137/S0036144503426074.  Google Scholar

[3]

S. Campbell and C. Meyer, "Generalized Inverses of Linear Transformations," Pitman, London, 1979; Dover Publications, 1991; SIAM, Philadelphia, 2008.  Google Scholar

[4]

Z. Cao, On the convergence of iterative methods for solving singular linear systems, Journal of Computational and Applied Mathematics, 145 (2002), 1-9. doi: 10.1016/S0377-0427(01)00531-3.  Google Scholar

[5]

Z. Cao, On the convergence of general stationary linear iterative methods for singular linear systems, SIAM Journal on Matrix Analysis and Applications, 29 (2008), 1382-1388. doi: 10.1137/060671243.  Google Scholar

[6]

X. Chen and R. E. Hartwig, The Picard iteration and its application, Linear and Multilinear Algebra, 54 (2006), 329-341. doi: 10.1080/03081080500209703.  Google Scholar

[7]

X. Cui, Y. Wei and N. Zhang, Quotient convergence and multi-splitting methods for solving singular linear equations, Calcolo, 44 (2007), 21-31. doi: 10.1007/s10092-007-0127-y.  Google Scholar

[8]

M. Eiermann, I. Marek and W. Niethammer, On the solution of singular linear systems of algebraic equations by semi-iterative methods, Numerische Mathematik, 53 (1988), 265-283. doi: 10.1007/BF01404464.  Google Scholar

[9]

A. Frommer, R. Nabben and D. Szyld, Convergence of stationary iterative methods for Hermitian semidefinite linear systems and applications to Schwarz methods, SIAM Journal on Matrix Analysis and Applications, 30 (2008), 925-938. doi: 2009m:65055.  Google Scholar

[10]

F. R. Gantmacher, "The Theory of Matrices," Chelsea, New York, 1 (1960).  Google Scholar

[11]

N. Higham and P. Knight, Finite precision behavior of stationary iteration for solving singular systems, Linear Algebra and Its Applications, 192 (1993), 165-186. doi: 10.1016/0024-3795(93)90242-G.  Google Scholar

[12]

H. Keller, On the solution of singular and semi-definite linear systems by iteration, SIAM Journal on Numerical Analysis, 2 (1965), 281-290. Google Scholar

[13]

Y. Lee, J. Wu and L. Zikatanov, On the convergence of iterative methods for semidefinite linear systems, SIAM Journal on Matrix Analysis and Applications, 28 (2006), 634-641. doi: 10.1137/050644197.  Google Scholar

[14]

L. Lin, Y. Wei, C. Woo and J. Zhou, On the convergence of splittings for semidefinite linear systems, Linear Algebra and its Applications, 429 (2008), 2555-2566. doi: 10.1016/j.laa.2007.12.019.  Google Scholar

[15]

L. Lin, Y. Wei and N. Zhang, Convergence and quotient convergence of iterative methods for solving singular linear equations with index one, Linear Algebra and its Applications, 430 (2009), 1665-1674. doi: 10.1016/j.laa.2008.06.019.  Google Scholar

[16]

G. I. Marchuk and Y. Kuznetzov, "Iterative Methods and Quadratic Functionals," Science Press, Norvosibirsk, in Russian, 1972. Google Scholar

[17]

M. Neumann, Subproper splitting for rectangular matrices, Linear Algebra and its Applications, 14 (1976), 41-51. doi: 10.1016/0024-3795(76)90062-8.  Google Scholar

[18]

Y. Song, Semiconvergence of nonnegative splittings for singular matrices, Numerische Mathematik, 85 (2000), 109-127. doi: 10.1007/s002110050479.  Google Scholar

[19]

G. Wang, Y. Wei, and S. Qiao, "Generalized Inverses: Theory and Computations," Science Press, Beijing, 2004. Google Scholar

[20]

N. Zhang and Y. Wei, On the convergence of general stationary iterative methods for range-Hermitian singular linear systems, Numerical Linear Algebra with Applications, 17 (2010), 139-154. doi: 10.1002/nla.663.  Google Scholar

[1]

Xiao Tang, Yingying Zeng, Weinian Zhang. Interval homeomorphic solutions of a functional equation of nonautonomous iterations. Discrete & Continuous Dynamical Systems, 2020, 40 (12) : 6967-6984. doi: 10.3934/dcds.2020214
[2]

Grzegorz Graff, Piotr Nowak-Przygodzki. Fixed point indices of iterations of $C^1$ maps in $R^3$. Discrete & Continuous Dynamical Systems, 2006, 16 (4) : 843-856. doi: 10.3934/dcds.2006.16.843
[3]

Shengxin Zhu, Tongxiang Gu, Xingping Liu. AIMS: Average information matrix splitting. Mathematical Foundations of Computing, 2020, 3 (4) : 301-308. doi: 10.3934/mfc.2020012
[4]

Daniel Alpay, Eduard Tsekanovskiĭ. Subclasses of Herglotz-Nevanlinna matrix-valued functtons and linear systems. Conference Publications, 2001, 2001 (Special) : 1-13. doi: 10.3934/proc.2001.2001.1
[5]

Guangcun Lu. Parameterized splitting theorems and bifurcations for potential operators, Part II: Applications to quasi-linear elliptic equations and systems. Discrete & Continuous Dynamical Systems, 2021  doi: 10.3934/dcds.2021155
[6]

Tohru Nakamura, Shinya Nishibata, Naoto Usami. Convergence rate of solutions towards the stationary solutions to symmetric hyperbolic-parabolic systems in half space. Kinetic & Related Models, 2018, 11 (4) : 757-793. doi: 10.3934/krm.2018031
[7]

Yanxing Cui, Chuanlong Wang, Ruiping Wen. On the convergence of generalized parallel multisplitting iterative methods for semidefinite linear systems. Numerical Algebra, Control & Optimization, 2012, 2 (4) : 863-873. doi: 10.3934/naco.2012.2.863
[8]

Marco Di Francesco, Donatella Donatelli. Singular convergence of nonlinear hyperbolic chemotaxis systems to Keller-Segel type models. Discrete & Continuous Dynamical Systems - B, 2010, 13 (1) : 79-100. doi: 10.3934/dcdsb.2010.13.79
[9]

Zhili Ge, Gang Qian, Deren Han. Global convergence of an inexact operator splitting method for monotone variational inequalities. Journal of Industrial & Management Optimization, 2011, 7 (4) : 1013-1026. doi: 10.3934/jimo.2011.7.1013
[10]

Peizhao Yu, Guoshan Zhang, Yi Zhang. Decoupling of cubic polynomial matrix systems. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 13-26. doi: 10.3934/naco.2020012
[11]

Franck Davhys Reval Langa, Morgan Pierre. A doubly splitting scheme for the Caginalp system with singular potentials and dynamic boundary conditions. Discrete & Continuous Dynamical Systems - S, 2021, 14 (2) : 653-676. doi: 10.3934/dcdss.2020353
[12]

Liejune Shiau, Roland Glowinski. Operator splitting method for friction constrained dynamical systems. Conference Publications, 2005, 2005 (Special) : 806-815. doi: 10.3934/proc.2005.2005.806
[13]

Nguyen H. Sau, Vu N. Phat. LP approach to exponential stabilization of singular linear positive time-delay systems via memory state feedback. Journal of Industrial & Management Optimization, 2018, 14 (2) : 583-596. doi: 10.3934/jimo.2017061
[14]

Yaonan Ma, Li-Zhi Liao. The Glowinski–Le Tallec splitting method revisited: A general convergence and convergence rate analysis. Journal of Industrial & Management Optimization, 2021, 17 (4) : 1681-1711. doi: 10.3934/jimo.2020040
[15]

Parikshit Upadhyaya, Elias Jarlebring, Emanuel H. Rubensson. A density matrix approach to the convergence of the self-consistent field iteration. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 99-115. doi: 10.3934/naco.2020018
[16]

Wei-guo Wang, Wei-chao Wang, Ren-cang Li. Deflating irreducible singular M-matrix algebraic Riccati equations. Numerical Algebra, Control & Optimization, 2013, 3 (3) : 491-518. doi: 10.3934/naco.2013.3.491
[17]

Davide Guidetti. Convergence to a stationary state of solutions to inverse problems of parabolic type. Discrete & Continuous Dynamical Systems - S, 2013, 6 (3) : 711-722. doi: 10.3934/dcdss.2013.6.711
[18]

M. Grasselli, Hana Petzeltová, Giulio Schimperna. Convergence to stationary solutions for a parabolic-hyperbolic phase-field system. Communications on Pure & Applied Analysis, 2006, 5 (4) : 827-838. doi: 10.3934/cpaa.2006.5.827
[19]

Claudio Marchi. On the convergence of singular perturbations of Hamilton-Jacobi equations. Communications on Pure & Applied Analysis, 2010, 9 (5) : 1363-1377. doi: 10.3934/cpaa.2010.9.1363
[20]

Angelo B. Mingarelli. Nonlinear functionals in oscillation theory of matrix differential systems. Communications on Pure & Applied Analysis, 2004, 3 (1) : 75-84. doi: 10.3934/cpaa.2004.3.75

 Impact Factor: 

Tools

Metrics

  • PDF downloads (62)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences | Privacy Policy