American Institute of Mathematical Sciences

Advanced
April  2016, 12(2): 505-514. doi: 10.3934/jimo.2016.12.505

A weak condition for global stability of delayed neural networks

Ricai Luo 1, , Honglei Xu 2, , Wu-Sheng Wang 3, , Jie Sun 4, and  Wei Xu 5,

1. 

School of Computer and Information Engineering, Hechi University, Guangxi, Yizhou 546300, China
2. 

Department of Mathematics and Statistics, Curtin University of Technology, Perth, WA 6845
3. 

School of Mathematics and Statistics, Hechi University, Guangxi, Yizhou 546300, China
4. 

Department of Mathematics and Statistics, Curtin University, Perth,WA 6845, Australia
5. 

School of Information Science and Engineering, Central South University, Changsha, Hunan 410083, China

Received  September 2014 Revised  February 2015 Published  June 2015

The classical analysis of asymptotical and exponential stability of neural networks needs assumptions on the existence of a positive Lyapunov function $V$ and on the strict negativity of the function $dV/dt$, which often come as a result of boundedness or uniformly almost periodicity of the activation functions. In this paper, we investigate the asymptotical stability problem of Hopfield neural networks with time delays under weaker conditions. By constructing a suitable Lyapunov function, sufficient conditions are derived to guarantee global asymptotical stability and exponential stability of the equilibrium of the system. These conditions do not require the strict negativity of $dV/dt $, nor do they require that the activation functions to be bounded or uniformly almost periodic.
Keywords: exponential stability, time delays, negative semi-definite, Asymptotical stability, neural networks..
Mathematics Subject Classification: 93D20, 93C10; Secondary: 92B2.
Citation: Ricai Luo, Honglei Xu, Wu-Sheng Wang, Jie Sun, Wei Xu. A weak condition for global stability of delayed neural networks. Journal of Industrial and Management Optimization, 2016, 12 (2) : 505-514. doi: 10.3934/jimo.2016.12.505
References:
[1]

S. Abe, J. Kawakami and K. Hirasawa, Solving inequality constrained combinatorial optimization problems by the hopfield neural networks, Neural Networks, 5 (1992), 663-670. doi: 10.1016/S0893-6080(05)80043-7.

[2]

P. Baldi and A. F. Atiya, How delays affect neural dynamics and learning, IEEE Transactions on Neural Networks, 5 (1994), 612-621. doi: 10.1109/72.298231.

[3]

D. Calabuig, J. F. Monserrat, D. Gmez-Barquero and O. Lzaro, An efficient dynamic resource allocation algorithm for packet-switched communication networks based on Hopfield neural excitation method, Neurocomputing, 71 (2008), 3439-3446.

[4]

Y. Chen and H. Xu, Exponential stability analysis and impulsive tracking control of uncertain time-delayed systems, Journal of Global Optimization, 52 (2012), 323-334. doi: 10.1007/s10898-011-9669-2.

[5]

M. Forti, On global asymptotic stability of a class of nonlinear systems arising in neural network theory, J. Differential Equations, 113 (1994), 246-264. doi: 10.1006/jdeq.1994.1123.

[6]

M. Forti, S. Maneti and M. Marini, Necessary and sufficient conditions for absolute stability of neural networks, IEEE Trans. Circuits Syst. I, 41 (1994), 491-494. doi: 10.1109/81.298364.

[7]

M. Forti and A. Tesi, New conditions for global stability of neural networks with application to linear and quadratic programming problems, IEEE Trans. Circuits Syst. I, 42 (1995) 354-366. doi: 10.1109/81.401145.

[8]

A. Gasull, J. Llibre and J. Sotomayor, Global asymptotic stability of differential equations in the plane, J. Differential Equations, 91 (1991) 327-336. doi: 10.1016/0022-0396(91)90143-W.

[9]

K. Gopalsamy and X. He, Stability in asymmetric Hopfield nets with transmission delays, Physica D, 76 (1994), 344-358. doi: 10.1016/0167-2789(94)90043-4.

[10]

M. W. Hirsch, Convergent activation dynamics in continuous time networks, Neural Netw., 2 (1989), 331-349. doi: 10.1016/0893-6080(89)90018-X.

[11]

J. J. Hopfield, Neurons with graded response have collective computational properties like those of two-state neurons, Proc. Aead. Sci. USA, 81 (1984), 3088-3092. doi: 10.1073/pnas.81.10.3088.

[12]

A. O. Ignatyev, On the stability of equilibrium for almost periodic systems, Nonlinear Anal., 29 (1997), 957-962. doi: 10.1016/S0362-546X(96)00078-8.

[13]

E. Kaszkurewicz and A. Bhaya, On a class of globally stable neural circuits, IEEE Trans. Circuits Syst. I, 41 (1994), 171-174. doi: 10.1109/81.269055.

[14]

D. G. Kelly, Stability in contractive nonlinear neural networks, IEEE Trans. Biomed. Eng., 3 (1990), 231-242. doi: 10.1109/10.52325.

[15]

N. Laskaris, S. Fotopoulos, P. Papathanasopoulos and A. Bezerianos, Robust moving averages, with Hopfield neural network implementation, for monitoring evoked potential signals, Electroencephalography and Clinical Neurophysiology/ Evoked Potentials Section, 104 (1997), 151-156. doi: 10.1016/S0168-5597(97)96681-8.

[16]

X. Liao, G. Chen and E. N. Sanchez, Delay-dependent exponential stability analysis of delayed neural networks: an LMI approach, Neural Networks, 15 (2002), 855-866

[17]

X. Liu and T. Chen, A new result on the global convergence of Hopfield neural networks, IEEE Trans. Circuits Syst. I, 49 (2002), 1514-1516. doi: 10.1109/TCSI.2002.803358.

[18]

C. Marcus and R. Westervelt, Stability of analog neural networks with delay, Phys. Rev. A, 39 (1989), 347-359. doi: 10.1103/PhysRevA.39.347.

[19]

A. N. Markus and H. Yamabe, Global stability criteria for differential systems, Osaka Math. J., 12 (1960), 305-317.

[20]

Z. Orman, New sufficient conditions for global stability of neutral-type neural networks with time delays, Neurocomputing, 97 (2012), 141-148. doi: 10.1016/j.neucom.2012.05.016.

[21]

S. Rout, Seethalakshmy, P. Srivastava and J. Majumdar, Multi-modal image segmentation using a modified Hopfield neural network, Pattern Recognition, 31 (1998), 743-750. doi: 10.1016/S0031-3203(97)00089-7.

[22]

R. Sammouda, N. Adgaba, A. Touir and A. Al-Ghamdi, Agriculture satellite image segmentation using a modified artificial Hopfield neural network, Computers in Human Behavior, 30 (2014), 436-441. doi: 10.1016/j.chb.2013.06.025.

[23]

P. Suganthan, E. Teoh and D. Mital, Pattern recognition by homomorphic graph matching using Hopfield neural networks, Image and Vision Computing, 13 (1995), 45-60. doi: 10.1016/0262-8856(95)91467-R.

[24]

H. Tamura, Z. Zhang, X. S. Xu, M. Ishii and Z. Tang, Lagrangian object relaxation neural network for combinatorial optimization problems, Neurocomputing, 68 (2005), 297-305. doi: 10.1016/j.neucom.2005.03.003.

[25]

W. Walter, Analysis I, second ed., Springer-Verlag, Berlin, 1990.

[26]

R. L. Wang, Z. Tang and Q. P. Cao, A lear ning method in Hopfield neural network for combinatorial optimization problem, Neurocomputing, 48 (2002), 1021-1024.

[27]

H. Wersing, W. J. Beyn and H. Ritter, Dynamical stability conditions for recurrent neural networks with unsaturating piecewise linear transfer functions, Neural Comput., 13 (2001), 1811-1825. doi: 10.1162/08997660152469350.

[28]

J. Wu, Symmetric functional-differential equations and neural networks with memory, Trans. Am. Math. Soc., 350 (1999), 4799-4838. doi: 10.1090/S0002-9947-98-02083-2.

[29]

J. Wu and X. Zou, Patterns of sustained oscillations in neural networks with time delayed interactions, Appl. Math. Comput., 73 (1995), 55-75. doi: 10.1016/0096-3003(94)00203-G.

[30]

H. Xu and Y. Chen and K. L. Teo, Global exponential stability of impulsive discrete-time neural networks with time-varying delays, Applied Mathematics and Computations, 217 (2010), 537-544. doi: 10.1016/j.amc.2010.05.087.

[31]

H. Xu and K. L. Teo, $H_\infty$ optimal stabilization of a class of uncertain impulsive systems: an LMI approach, Journal of Industrial and management optimization, 5 (2009), 153-159. doi: 10.3934/jimo.2009.5.153.

[32]

F. Zhang, The Schur complement and its applications. Numerical Methods and Algorithms, New York: Springer-Verlag, 4 (2005), 34. doi: 10.1007/b105056.

[33]

W. Zhang, A weak condition of globally asymptotic stability for neural networks, Applied Mathematics Letters, 19 (2006), 1210-1215. doi: 10.1016/j.aml.2006.01.009.

[34]

Available from:, ., (). 

show all references

References:
[1]

S. Abe, J. Kawakami and K. Hirasawa, Solving inequality constrained combinatorial optimization problems by the hopfield neural networks, Neural Networks, 5 (1992), 663-670. doi: 10.1016/S0893-6080(05)80043-7.

[2]

P. Baldi and A. F. Atiya, How delays affect neural dynamics and learning, IEEE Transactions on Neural Networks, 5 (1994), 612-621. doi: 10.1109/72.298231.

[3]

D. Calabuig, J. F. Monserrat, D. Gmez-Barquero and O. Lzaro, An efficient dynamic resource allocation algorithm for packet-switched communication networks based on Hopfield neural excitation method, Neurocomputing, 71 (2008), 3439-3446.

[4]

Y. Chen and H. Xu, Exponential stability analysis and impulsive tracking control of uncertain time-delayed systems, Journal of Global Optimization, 52 (2012), 323-334. doi: 10.1007/s10898-011-9669-2.

[5]

M. Forti, On global asymptotic stability of a class of nonlinear systems arising in neural network theory, J. Differential Equations, 113 (1994), 246-264. doi: 10.1006/jdeq.1994.1123.

[6]

M. Forti, S. Maneti and M. Marini, Necessary and sufficient conditions for absolute stability of neural networks, IEEE Trans. Circuits Syst. I, 41 (1994), 491-494. doi: 10.1109/81.298364.

[7]

M. Forti and A. Tesi, New conditions for global stability of neural networks with application to linear and quadratic programming problems, IEEE Trans. Circuits Syst. I, 42 (1995) 354-366. doi: 10.1109/81.401145.

[8]

A. Gasull, J. Llibre and J. Sotomayor, Global asymptotic stability of differential equations in the plane, J. Differential Equations, 91 (1991) 327-336. doi: 10.1016/0022-0396(91)90143-W.

[9]

K. Gopalsamy and X. He, Stability in asymmetric Hopfield nets with transmission delays, Physica D, 76 (1994), 344-358. doi: 10.1016/0167-2789(94)90043-4.

[10]

M. W. Hirsch, Convergent activation dynamics in continuous time networks, Neural Netw., 2 (1989), 331-349. doi: 10.1016/0893-6080(89)90018-X.

[11]

J. J. Hopfield, Neurons with graded response have collective computational properties like those of two-state neurons, Proc. Aead. Sci. USA, 81 (1984), 3088-3092. doi: 10.1073/pnas.81.10.3088.

[12]

A. O. Ignatyev, On the stability of equilibrium for almost periodic systems, Nonlinear Anal., 29 (1997), 957-962. doi: 10.1016/S0362-546X(96)00078-8.

[13]

E. Kaszkurewicz and A. Bhaya, On a class of globally stable neural circuits, IEEE Trans. Circuits Syst. I, 41 (1994), 171-174. doi: 10.1109/81.269055.

[14]

D. G. Kelly, Stability in contractive nonlinear neural networks, IEEE Trans. Biomed. Eng., 3 (1990), 231-242. doi: 10.1109/10.52325.

[15]

N. Laskaris, S. Fotopoulos, P. Papathanasopoulos and A. Bezerianos, Robust moving averages, with Hopfield neural network implementation, for monitoring evoked potential signals, Electroencephalography and Clinical Neurophysiology/ Evoked Potentials Section, 104 (1997), 151-156. doi: 10.1016/S0168-5597(97)96681-8.

[16]

X. Liao, G. Chen and E. N. Sanchez, Delay-dependent exponential stability analysis of delayed neural networks: an LMI approach, Neural Networks, 15 (2002), 855-866

[17]

X. Liu and T. Chen, A new result on the global convergence of Hopfield neural networks, IEEE Trans. Circuits Syst. I, 49 (2002), 1514-1516. doi: 10.1109/TCSI.2002.803358.

[18]

C. Marcus and R. Westervelt, Stability of analog neural networks with delay, Phys. Rev. A, 39 (1989), 347-359. doi: 10.1103/PhysRevA.39.347.

[19]

A. N. Markus and H. Yamabe, Global stability criteria for differential systems, Osaka Math. J., 12 (1960), 305-317.

[20]

Z. Orman, New sufficient conditions for global stability of neutral-type neural networks with time delays, Neurocomputing, 97 (2012), 141-148. doi: 10.1016/j.neucom.2012.05.016.

[21]

S. Rout, Seethalakshmy, P. Srivastava and J. Majumdar, Multi-modal image segmentation using a modified Hopfield neural network, Pattern Recognition, 31 (1998), 743-750. doi: 10.1016/S0031-3203(97)00089-7.

[22]

R. Sammouda, N. Adgaba, A. Touir and A. Al-Ghamdi, Agriculture satellite image segmentation using a modified artificial Hopfield neural network, Computers in Human Behavior, 30 (2014), 436-441. doi: 10.1016/j.chb.2013.06.025.

[23]

P. Suganthan, E. Teoh and D. Mital, Pattern recognition by homomorphic graph matching using Hopfield neural networks, Image and Vision Computing, 13 (1995), 45-60. doi: 10.1016/0262-8856(95)91467-R.

[24]

H. Tamura, Z. Zhang, X. S. Xu, M. Ishii and Z. Tang, Lagrangian object relaxation neural network for combinatorial optimization problems, Neurocomputing, 68 (2005), 297-305. doi: 10.1016/j.neucom.2005.03.003.

[25]

W. Walter, Analysis I, second ed., Springer-Verlag, Berlin, 1990.

[26]

R. L. Wang, Z. Tang and Q. P. Cao, A lear ning method in Hopfield neural network for combinatorial optimization problem, Neurocomputing, 48 (2002), 1021-1024.

[27]

H. Wersing, W. J. Beyn and H. Ritter, Dynamical stability conditions for recurrent neural networks with unsaturating piecewise linear transfer functions, Neural Comput., 13 (2001), 1811-1825. doi: 10.1162/08997660152469350.

[28]

J. Wu, Symmetric functional-differential equations and neural networks with memory, Trans. Am. Math. Soc., 350 (1999), 4799-4838. doi: 10.1090/S0002-9947-98-02083-2.

[29]

J. Wu and X. Zou, Patterns of sustained oscillations in neural networks with time delayed interactions, Appl. Math. Comput., 73 (1995), 55-75. doi: 10.1016/0096-3003(94)00203-G.

[30]

H. Xu and Y. Chen and K. L. Teo, Global exponential stability of impulsive discrete-time neural networks with time-varying delays, Applied Mathematics and Computations, 217 (2010), 537-544. doi: 10.1016/j.amc.2010.05.087.

[31]

H. Xu and K. L. Teo, $H_\infty$ optimal stabilization of a class of uncertain impulsive systems: an LMI approach, Journal of Industrial and management optimization, 5 (2009), 153-159. doi: 10.3934/jimo.2009.5.153.

[32]

F. Zhang, The Schur complement and its applications. Numerical Methods and Algorithms, New York: Springer-Verlag, 4 (2005), 34. doi: 10.1007/b105056.

[33]

W. Zhang, A weak condition of globally asymptotic stability for neural networks, Applied Mathematics Letters, 19 (2006), 1210-1215. doi: 10.1016/j.aml.2006.01.009.

[34]

Available from:, ., (). 

[1]

Muhammet Mert Ketencigil, Ozlem Faydasicok, Sabri Arik. Novel criteria for robust stability of Cohen-Grossberg neural networks with multiple time delays. Discrete and Continuous Dynamical Systems - S, 2022  doi: 10.3934/dcdss.2022081
[2]

Yi Xu, Jinjie Liu, Liqun Qi. A new class of positive semi-definite tensors. Journal of Industrial and Management Optimization, 2020, 16 (2) : 933-943. doi: 10.3934/jimo.2018186
[3]

Sylvia Novo, Rafael Obaya, Ana M. Sanz. Exponential stability in non-autonomous delayed equations with applications to neural networks. Discrete and Continuous Dynamical Systems, 2007, 18 (2&3) : 517-536. doi: 10.3934/dcds.2007.18.517
[4]

Wei Huang, Ka-Fai Cedric Yiu, Henry Y. K. Lau. Semi-definite programming based approaches for real-time tractor localization in port container terminals. Numerical Algebra, Control and Optimization, 2013, 3 (4) : 665-680. doi: 10.3934/naco.2013.3.665
[5]

Lipu Zhang, Yinghong Xu, Zhengjing Jin. An efficient algorithm for convex quadratic semi-definite optimization. Numerical Algebra, Control and Optimization, 2012, 2 (1) : 129-144. doi: 10.3934/naco.2012.2.129
[6]

Ozlem Faydasicok. Further stability analysis of neutral-type Cohen-Grossberg neural networks with multiple delays. Discrete and Continuous Dynamical Systems - S, 2021, 14 (4) : 1245-1258. doi: 10.3934/dcdss.2020359
[7]

Ying Sue Huang, Chai Wah Wu. Stability of cellular neural network with small delays. Conference Publications, 2005, 2005 (Special) : 420-426. doi: 10.3934/proc.2005.2005.420
[8]

Quan Hai, Shutang Liu. Mean-square delay-distribution-dependent exponential synchronization of chaotic neural networks with mixed random time-varying delays and restricted disturbances. Discrete and Continuous Dynamical Systems - B, 2021, 26 (6) : 3097-3118. doi: 10.3934/dcdsb.2020221
[9]

Zengyun Wang, Jinde Cao, Zuowei Cai, Lihong Huang. Finite-time stability of impulsive differential inclusion: Applications to discontinuous impulsive neural networks. Discrete and Continuous Dynamical Systems - B, 2021, 26 (5) : 2677-2692. doi: 10.3934/dcdsb.2020200
[10]

Tingting Su, Xinsong Yang. Finite-time synchronization of competitive neural networks with mixed delays. Discrete and Continuous Dynamical Systems - B, 2016, 21 (10) : 3655-3667. doi: 10.3934/dcdsb.2016115
[11]

Cheng-Hsiung Hsu, Suh-Yuh Yang. Traveling wave solutions in cellular neural networks with multiple time delays. Conference Publications, 2005, 2005 (Special) : 410-419. doi: 10.3934/proc.2005.2005.410
[12]

Stephane Chretien, Paul Clarkson. A fast algorithm for the semi-definite relaxation of the state estimation problem in power grids. Journal of Industrial and Management Optimization, 2020, 16 (1) : 431-443. doi: 10.3934/jimo.2018161
[13]

Monika Eisenmann, Etienne Emmrich, Volker Mehrmann. Convergence of the backward Euler scheme for the operator-valued Riccati differential equation with semi-definite data. Evolution Equations and Control Theory, 2019, 8 (2) : 315-342. doi: 10.3934/eect.2019017
[14]

Yue Lu, Ying-En Ge, Li-Wei Zhang. An alternating direction method for solving a class of inverse semi-definite quadratic programming problems. Journal of Industrial and Management Optimization, 2016, 12 (1) : 317-336. doi: 10.3934/jimo.2016.12.317
[15]

Xiantao Xiao, Liwei Zhang, Jianzhong Zhang. On convergence of augmented Lagrangian method for inverse semi-definite quadratic programming problems. Journal of Industrial and Management Optimization, 2009, 5 (2) : 319-339. doi: 10.3934/jimo.2009.5.319
[16]

Ivanka Stamova, Gani Stamov. On the stability of sets for reaction–diffusion Cohen–Grossberg delayed neural networks. Discrete and Continuous Dynamical Systems - S, 2021, 14 (4) : 1429-1446. doi: 10.3934/dcdss.2020370
[17]

Desheng Li, P.E. Kloeden. Robustness of asymptotic stability to small time delays. Discrete and Continuous Dynamical Systems, 2005, 13 (4) : 1007-1034. doi: 10.3934/dcds.2005.13.1007
[18]

Zhen Jin, Zhien Ma. The stability of an SIR epidemic model with time delays. Mathematical Biosciences & Engineering, 2006, 3 (1) : 101-109. doi: 10.3934/mbe.2006.3.101
[19]

Ruoxia Li, Huaiqin Wu, Xiaowei Zhang, Rong Yao. Adaptive projective synchronization of memristive neural networks with time-varying delays and stochastic perturbation. Mathematical Control and Related Fields, 2015, 5 (4) : 827-844. doi: 10.3934/mcrf.2015.5.827
[20]

Zhigang Zeng, Tingwen Huang. New passivity analysis of continuous-time recurrent neural networks with multiple discrete delays. Journal of Industrial and Management Optimization, 2011, 7 (2) : 283-289. doi: 10.3934/jimo.2011.7.283

2020 Impact Factor: 1.801

Tools

Metrics

  • PDF downloads (88)
  • HTML views (0)
  • Cited by (2)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy