American Institute of Mathematical Sciences

Advanced
December  2020, 25(12): 4535-4551. doi: 10.3934/dcdsb.2020111

Consensus in discrete-time multi-agent systems with uncertain topologies and random delays governed by a Markov chain

Xi Zhu 1,, , Meixia Li 2, and  Chunfa Li 1,

1. 

School of Management, Tianjin University of Technology, Tianjin 300384, China
2. 

Department of Basic Education, Tianjin City Vocational College, Tianjin 300250, China

* Corresponding author: Xi Zhu

Received  April 2019 Revised  October 2019 Published  March 2020

Fund Project: The first author is supported by the National Natural Science Foundation of China grant 61440058, 11501412 and 11401073

In this paper, we study consensus problem in a discrete-time multi-agent system with uncertain topologies and random delays governed by a Markov chain. The communication topology is assumed to be directed but interrupted by system uncertainties. Furthermore, the system delays are modeled by a Markov chain. We first use a reduced-order system featuring the error dynamics to transform the consensus problem of the original one into the stabilization of the error dynamic system. By using the linear matrix inequality method and the stability theory in stochastic systems with time-delay, several sufficient conditions are established for the mean square stability of the error dynamics which guarantees consensus. By redesigning its adjacency matrices, we develop a switching control scheme which is delay-dependent. Finally, simulation results are worked out to illustrate the theoretical results.

Keywords: Multi-agent system, consensus, random delay, Markov chain, uncertain topology.
Mathematics Subject Classification: Primary: 37B25, 39A30; Secondary: 60J10.
Citation: Xi Zhu, Meixia Li, Chunfa Li. Consensus in discrete-time multi-agent systems with uncertain topologies and random delays governed by a Markov chain. Discrete & Continuous Dynamical Systems - B, 2020, 25 (12) : 4535-4551. doi: 10.3934/dcdsb.2020111
References:
[1]

S. Boyd, L. El Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 1994. doi: 10.1137/1.9781611970777.  Google Scholar

[2]

W. He, G. Chen, Q.-L. Han and F. Qian, Network-based leader-following consensus of nonlinear multi-agent systems via distributed impulsive control, Information Sciences, 380 (2017), 145-158.  doi: 10.1016/j.ins.2015.06.005.  Google Scholar

[3]

Y. M. Chen and W.-Y. Wu, Cooperative electronic attack for groups of unmanned air vehicles based on multi-agent simulation and evaluation, International Journal of Computer Science Issues, 9 (2012), 6 pp. Google Scholar

[4]

O. L. V. Costa, M. D. Fragoso and R. P. Marques, Discrete-time Markov jump linear systems, Springer-Verlag London, Ltd., London, 2005. doi: 10.1007/b138575.  Google Scholar

[5]

P. Lin, W. Lu and Y. Song, Distributed nested rotating consensus problem of multi-agent systems, The 26th Chinese Control and Decision Conference, (2014 CCDC), (2014), 1785–1789. Google Scholar

[6]

S. Liu, L. Xie and F. L. Lewis, Synchronization of multi-agent systems with delayed control input information from neighbors, Automatica J. IFAC, 47 (2011), 2152-2164.  doi: 10.1016/j.automatica.2011.03.015.  Google Scholar

[7]

J. Monteil, R. Billot, J. Sau, F. Armetta, S. Hassas and N.-E. E. Faouzi, Cooperative highway traffic: Multi-agent modeling and robustness assessment of local perturbations, Transportation Research Record, 2391 (2013), 1-10.   Google Scholar

[8]

R. Olfati-Saber and R. M. Murray, Consensus problems in networks of agents with switching topology and time-delays, IEEE Trans. Automat. Control, 49 (2004), 1520-1533.  doi: 10.1109/TAC.2004.834113.  Google Scholar

[9]

W. Ren, R. W. Beard and E. M. Atkins, A survey of consensus problems in multi-agent coordination, Proceedings of the 2005, American Control Conference, 2005, 3 (2005), 1859-1864.   Google Scholar

[10]

W. Ren and R. W. Beard, Consensus seeking in multiagent systems under dynamically changing interaction topologies, IEEE Trans. Automat. Control, 50 (2005), 655-661.  doi: 10.1109/TAC.2005.846556.  Google Scholar

[11]

H. J. Savino, C. R. P. dos Santos, F. O. Souza, L. C. A. Pimenta, M. de Oliveira and R. M. Palhares, Conditions for consensus of multi-agent systems with time-delays and uncertain switching topology, IEEE Transactions on Industrial Electronics, 63 (2016), 1258-1267.   Google Scholar

[12]

Y. Shang, Average consensus in multi-agent systems with uncertain topologies and multiple time-varying delays, Linear Algebra Appl., 459 (2014), 411-429.  doi: 10.1016/j.laa.2014.07.019.  Google Scholar

[13]

A. Soriano, E. J. Bernabeu, A. Valera and M. Vallés, Multi-agent systems platform for mobile robots collision avoidance, in International Conference on Practical Applications of Agents and Multi-Agent Systems (eds. Y. Demazeau, T. Ishida, J. M. Corchado and J. Bajo), Springer, Berlin, Heidelberg, 7879 (2013), 320–323. Google Scholar

[14]

Y. Sun, Average consensus in networks of dynamic agents with uncertain topologies and time-varying delays, J. Franklin Inst., 349 (2012), 1061-1073.  doi: 10.1016/j.jfranklin.2011.12.007.  Google Scholar

[15]

Y. G. Sun and L. Wang, Consensus problems in networks of agents with double-integrator dynamics and time-varying delays, Internat. J. Control, 82 (2009), 1937-1945.  doi: 10.1080/00207170902838269.  Google Scholar

[16]

T. Y. Teck and M. Chitre, Hierarchical multi-agent command and control system for autonomous underwater vehicles, 2012 IEEE/OES Autonomous Underwater Vehicles (AUV), (2012), 1–6. Google Scholar

[17]

G. Wen, Z. Duan, W. Yu and G. Chen, Consensus of second-order multi-agent systems with delayed nonlinear dynamics and intermittent communications, Internat. J. Control, 86 (2013), 322-331.  doi: 10.1080/00207179.2012.727473.  Google Scholar

[18]

J. Wu and Y. Shi, Consensus in multi-agent systems with random delays governed by a Markov chain, Systems Control Lett., 60 (2011), 863-870.  doi: 10.1016/j.sysconle.2011.07.004.  Google Scholar

[19]

G. Yang, Q. Yang, V. Kapila, D. Palmer and R. Vaidyanathan, Fuel optimal manoeuvres for multiple spacecraft formation reconfiguration using multi-agent optimization, International Journal of Robust and Nonlinear Control, 12 (2002), 243-283.   Google Scholar

show all references

References:
[1]

S. Boyd, L. El Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 1994. doi: 10.1137/1.9781611970777.  Google Scholar

[2]

W. He, G. Chen, Q.-L. Han and F. Qian, Network-based leader-following consensus of nonlinear multi-agent systems via distributed impulsive control, Information Sciences, 380 (2017), 145-158.  doi: 10.1016/j.ins.2015.06.005.  Google Scholar

[3]

Y. M. Chen and W.-Y. Wu, Cooperative electronic attack for groups of unmanned air vehicles based on multi-agent simulation and evaluation, International Journal of Computer Science Issues, 9 (2012), 6 pp. Google Scholar

[4]

O. L. V. Costa, M. D. Fragoso and R. P. Marques, Discrete-time Markov jump linear systems, Springer-Verlag London, Ltd., London, 2005. doi: 10.1007/b138575.  Google Scholar

[5]

P. Lin, W. Lu and Y. Song, Distributed nested rotating consensus problem of multi-agent systems, The 26th Chinese Control and Decision Conference, (2014 CCDC), (2014), 1785–1789. Google Scholar

[6]

S. Liu, L. Xie and F. L. Lewis, Synchronization of multi-agent systems with delayed control input information from neighbors, Automatica J. IFAC, 47 (2011), 2152-2164.  doi: 10.1016/j.automatica.2011.03.015.  Google Scholar

[7]

J. Monteil, R. Billot, J. Sau, F. Armetta, S. Hassas and N.-E. E. Faouzi, Cooperative highway traffic: Multi-agent modeling and robustness assessment of local perturbations, Transportation Research Record, 2391 (2013), 1-10.   Google Scholar

[8]

R. Olfati-Saber and R. M. Murray, Consensus problems in networks of agents with switching topology and time-delays, IEEE Trans. Automat. Control, 49 (2004), 1520-1533.  doi: 10.1109/TAC.2004.834113.  Google Scholar

[9]

W. Ren, R. W. Beard and E. M. Atkins, A survey of consensus problems in multi-agent coordination, Proceedings of the 2005, American Control Conference, 2005, 3 (2005), 1859-1864.   Google Scholar

[10]

W. Ren and R. W. Beard, Consensus seeking in multiagent systems under dynamically changing interaction topologies, IEEE Trans. Automat. Control, 50 (2005), 655-661.  doi: 10.1109/TAC.2005.846556.  Google Scholar

[11]

H. J. Savino, C. R. P. dos Santos, F. O. Souza, L. C. A. Pimenta, M. de Oliveira and R. M. Palhares, Conditions for consensus of multi-agent systems with time-delays and uncertain switching topology, IEEE Transactions on Industrial Electronics, 63 (2016), 1258-1267.   Google Scholar

[12]

Y. Shang, Average consensus in multi-agent systems with uncertain topologies and multiple time-varying delays, Linear Algebra Appl., 459 (2014), 411-429.  doi: 10.1016/j.laa.2014.07.019.  Google Scholar

[13]

A. Soriano, E. J. Bernabeu, A. Valera and M. Vallés, Multi-agent systems platform for mobile robots collision avoidance, in International Conference on Practical Applications of Agents and Multi-Agent Systems (eds. Y. Demazeau, T. Ishida, J. M. Corchado and J. Bajo), Springer, Berlin, Heidelberg, 7879 (2013), 320–323. Google Scholar

[14]

Y. Sun, Average consensus in networks of dynamic agents with uncertain topologies and time-varying delays, J. Franklin Inst., 349 (2012), 1061-1073.  doi: 10.1016/j.jfranklin.2011.12.007.  Google Scholar

[15]

Y. G. Sun and L. Wang, Consensus problems in networks of agents with double-integrator dynamics and time-varying delays, Internat. J. Control, 82 (2009), 1937-1945.  doi: 10.1080/00207170902838269.  Google Scholar

[16]

T. Y. Teck and M. Chitre, Hierarchical multi-agent command and control system for autonomous underwater vehicles, 2012 IEEE/OES Autonomous Underwater Vehicles (AUV), (2012), 1–6. Google Scholar

[17]

G. Wen, Z. Duan, W. Yu and G. Chen, Consensus of second-order multi-agent systems with delayed nonlinear dynamics and intermittent communications, Internat. J. Control, 86 (2013), 322-331.  doi: 10.1080/00207179.2012.727473.  Google Scholar

[18]

J. Wu and Y. Shi, Consensus in multi-agent systems with random delays governed by a Markov chain, Systems Control Lett., 60 (2011), 863-870.  doi: 10.1016/j.sysconle.2011.07.004.  Google Scholar

[19]

G. Yang, Q. Yang, V. Kapila, D. Palmer and R. Vaidyanathan, Fuel optimal manoeuvres for multiple spacecraft formation reconfiguration using multi-agent optimization, International Journal of Robust and Nonlinear Control, 12 (2002), 243-283.   Google Scholar

Figure 1.  Communication topology with a directed spanning tree
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Time delay ($ d_k $) over time
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  State of all nodes in the original system
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4.  State of all nodes under the control scheme in [18] when $ \alpha_0 = 0.26 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  Consensus with switching adjacency matrices when $ \alpha_0 = 0.26 $
Figure Options

Download full-size image

Download as PowerPoint slide

[1]

Feimin Zhong, Jinxing Xie, Yuwei Shen. Bargaining in a multi-echelon supply chain with power structure: KS solution vs. Nash solution. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020172
[2]

Hai Huang, Xianlong Fu. Optimal control problems for a neutral integro-differential system with infinite delay. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020107
[3]

Maoli Chen, Xiao Wang, Yicheng Liu. Collision-free flocking for a time-delay system. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 1223-1241. doi: 10.3934/dcdsb.2020251
[4]

Ting Liu, Guo-Bao Zhang. Global stability of traveling waves for a spatially discrete diffusion system with time delay. Electronic Research Archive, , () : -. doi: 10.3934/era.2021003
[5]

Wei-Chieh Chen, Bogdan Kazmierczak. Traveling waves in quadratic autocatalytic systems with complexing agent. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020364
[6]

Onur Şimşek, O. Erhun Kundakcioglu. Cost of fairness in agent scheduling for contact centers. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2021001
[7]

Jianquan Li, Xin Xie, Dian Zhang, Jia Li, Xiaolin Lin. Qualitative analysis of a simple tumor-immune system with time delay of tumor action. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020341
[8]

Fathalla A. Rihan, Hebatallah J. Alsakaji. Stochastic delay differential equations of three-species prey-predator system with cooperation among prey species. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020468
[9]

Yicheng Liu, Yipeng Chen, Jun Wu, Xiao Wang. Periodic consensus in network systems with general distributed processing delays. Networks & Heterogeneous Media, 2020  doi: 10.3934/nhm.2021002
[10]

Angelica Pachon, Federico Polito, Costantino Ricciuti. On discrete-time semi-Markov processes. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1499-1529. doi: 10.3934/dcdsb.2020170
[11]

Timothy Chumley, Renato Feres. Entropy production in random billiards. Discrete & Continuous Dynamical Systems - A, 2021, 41 (3) : 1319-1346. doi: 10.3934/dcds.2020319
[12]

Zsolt Saffer, Miklós Telek, Gábor Horváth. Analysis of Markov-modulated fluid polling systems with gated discipline. Journal of Industrial & Management Optimization, 2021, 17 (2) : 575-599. doi: 10.3934/jimo.2019124
[13]

Hui Lv, Xing'an Wang. Dissipative control for uncertain singular markovian jump systems via hybrid impulsive control. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 127-142. doi: 10.3934/naco.2020020
[14]

Xuefeng Zhang, Yingbo Zhang. Fault-tolerant control against actuator failures for uncertain singular fractional order systems. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 1-12. doi: 10.3934/naco.2020011
[15]

Honglin Yang, Jiawu Peng. Coordinating a supply chain with demand information updating. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020181
[16]

Xin Zhao, Tao Feng, Liang Wang, Zhipeng Qiu. Threshold dynamics and sensitivity analysis of a stochastic semi-Markov switched SIRS epidemic model with nonlinear incidence and vaccination. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2021010
[17]

Lin Jiang, Song Wang. Robust multi-period and multi-objective portfolio selection. Journal of Industrial & Management Optimization, 2021, 17 (2) : 695-709. doi: 10.3934/jimo.2019130
[18]

Bilel Elbetch, Tounsia Benzekri, Daniel Massart, Tewfik Sari. The multi-patch logistic equation. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021025
[19]

Patrick W. Dondl, Martin Jesenko. Threshold phenomenon for homogenized fronts in random elastic media. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 353-372. doi: 10.3934/dcdss.2020329
[20]

Sushil Kumar Dey, Bibhas C. Giri. Coordination of a sustainable reverse supply chain with revenue sharing contract. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020165

2019 Impact Factor: 1.27

Tools

Metrics

  • PDF downloads (200)
  • HTML views (344)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences