# American Institute of Mathematical Sciences

December  2020, 25(12): 4869-4903. doi: 10.3934/dcdsb.2020131

## A game-theoretic framework for autonomous vehicles velocity control: Bridging microscopic differential games and macroscopic mean field games

 1 Department of Applied Physics and Applied Mathematics, Columbia University, New York, NY 10027, United States 2 Department of Civil Engineering and Engineering Mechanics and Data Science Institute, Columbia University, New York, NY 10027, United States 3 Department of Applied Physics and Applied Mathematics and Data Science Institute, Columbia University, New York, NY 10027, United States 4 Department of Computer Science, Columbia University, New York, NY 10027, United States

* Corresponding author: Xuan Di

Received  November 2019 Revised  January 2020 Published  December 2020 Early access  April 2020

This paper proposes an efficient computational framework for longitudinal velocity control of a large number of autonomous vehicles (AVs) and develops a traffic flow theory for AVs. Instead of hypothesizing explicitly how AVs drive, our goal is to design future AVs as rational, utility-optimizing agents that continuously select optimal velocity over a period of planning horizon. With a large number of interacting AVs, this design problem can become computationally intractable. This paper aims to tackle such a challenge by employing mean field approximation and deriving a mean field game (MFG) as the limiting differential game with an infinite number of agents. The proposed micro-macro model allows one to define individuals on a microscopic level as utility-optimizing agents while translating rich microscopic behaviors to macroscopic models. Different from existing studies on the application of MFG to traffic flow models, the present study offers a systematic framework to apply MFG to autonomous vehicle velocity control. The MFG-based AV controller is shown to mitigate traffic jam faster than the LWR-based controller. MFG also embodies classical traffic flow models with behavioral interpretation, thereby providing a new traffic flow theory for AVs.

Citation: Kuang Huang, Xuan Di, Qiang Du, Xi Chen. A game-theoretic framework for autonomous vehicles velocity control: Bridging microscopic differential games and macroscopic mean field games. Discrete and Continuous Dynamical Systems - B, 2020, 25 (12) : 4869-4903. doi: 10.3934/dcdsb.2020131
##### References:

show all references

##### References:
From Micro to Macroscopic Traffic Flow Models
From an $N$-car differential game to MFG (adapted from [39])
Connections between MFG and LWR
[MFG-LWR]
Density Evolution of [MFG-NonSeparable] and [MFG-Separable]
Fundamental diagram of [MFG-NonSeparable]
Density, speed and optimal cost profiles for [MFG-NonSeparable] and [MFG-Separable] at $t = 0$ and $t = 1.5$
Convergence of solution algorithm in $L^1$ norm
$N = 21$ cars' trajectories integrated from the MFE solution of [MFG-NonSeparable]
MFE-constructed control cost v.s. best response strategy cost, $N = 21$ cars
Accuracy v.s. Number of cars
Classification of macroscopic traffic flow models
 Speed Acceleration rate Traditional First-order (e.g., LWR) Higher-order (e.g., PW/ARZ) Game-theoretic First-order MFGs Higher-order MFGs
 Speed Acceleration rate Traditional First-order (e.g., LWR) Higher-order (e.g., PW/ARZ) Game-theoretic First-order MFGs Higher-order MFGs
 [1] Kai Du, Jianhui Huang, Zhen Wu. Linear quadratic mean-field-game of backward stochastic differential systems. Mathematical Control and Related Fields, 2018, 8 (3&4) : 653-678. doi: 10.3934/mcrf.2018028 [2] Nicolas Crouseilles, Mohammed Lemou. An asymptotic preserving scheme based on a micro-macro decomposition for Collisional Vlasov equations: diffusion and high-field scaling limits. Kinetic and Related Models, 2011, 4 (2) : 441-477. doi: 10.3934/krm.2011.4.441 [3] Francesca Marcellini. Free-congested and micro-macro descriptions of traffic flow. Discrete and Continuous Dynamical Systems - S, 2014, 7 (3) : 543-556. doi: 10.3934/dcdss.2014.7.543 [4] René Aïd, Roxana Dumitrescu, Peter Tankov. The entry and exit game in the electricity markets: A mean-field game approach. Journal of Dynamics and Games, 2021, 8 (4) : 331-358. doi: 10.3934/jdg.2021012 [5] César Barilla, Guillaume Carlier, Jean-Michel Lasry. A mean field game model for the evolution of cities. Journal of Dynamics and Games, 2021, 8 (3) : 299-329. doi: 10.3934/jdg.2021017 [6] Yannick Viossat. Game dynamics and Nash equilibria. Journal of Dynamics and Games, 2014, 1 (3) : 537-553. doi: 10.3934/jdg.2014.1.537 [7] Carmen G. Higuera-Chan, Héctor Jasso-Fuentes, J. Adolfo Minjárez-Sosa. Control systems of interacting objects modeled as a game against nature under a mean field approach. Journal of Dynamics and Games, 2017, 4 (1) : 59-74. doi: 10.3934/jdg.2017004 [8] Anaïs Crestetto, Nicolas Crouseilles, Mohammed Lemou. Kinetic/fluid micro-macro numerical schemes for Vlasov-Poisson-BGK equation using particles. Kinetic and Related Models, 2012, 5 (4) : 787-816. doi: 10.3934/krm.2012.5.787 [9] Nidhal Gammoudi, Hasnaa Zidani. A differential game control problem with state constraints. Mathematical Control and Related Fields, 2022  doi: 10.3934/mcrf.2022008 [10] Fabio Camilli, Francisco Silva. A semi-discrete approximation for a first order mean field game problem. Networks and Heterogeneous Media, 2012, 7 (2) : 263-277. doi: 10.3934/nhm.2012.7.263 [11] Shuhua Zhang, Junying Zhao, Ming Yan, Xinyu Wang. Modeling and computation of mean field game with compound carbon abatement mechanisms. Journal of Industrial and Management Optimization, 2021, 17 (6) : 3333-3347. doi: 10.3934/jimo.2020121 [12] Stamatios Katsikas, Vassilli Kolokoltsov. Evolutionary, mean-field and pressure-resistance game modelling of networks security. Journal of Dynamics and Games, 2019, 6 (4) : 315-335. doi: 10.3934/jdg.2019021 [13] Martin Burger, Alexander Lorz, Marie-Therese Wolfram. Balanced growth path solutions of a Boltzmann mean field game model for knowledge growth. Kinetic and Related Models, 2017, 10 (1) : 117-140. doi: 10.3934/krm.2017005 [14] Elisabetta Carlini, Francisco J. Silva. A semi-Lagrangian scheme for a degenerate second order mean field game system. Discrete and Continuous Dynamical Systems, 2015, 35 (9) : 4269-4292. doi: 10.3934/dcds.2015.35.4269 [15] Alain Bensoussan, Xinwei Feng, Jianhui Huang. Linear-quadratic-Gaussian mean-field-game with partial observation and common noise. Mathematical Control and Related Fields, 2021, 11 (1) : 23-46. doi: 10.3934/mcrf.2020025 [16] Fabio Bagagiolo, Rosario Maggistro, Raffaele Pesenti. Origin-to-destination network flow with path preferences and velocity controls: A mean field game-like approach. Journal of Dynamics and Games, 2021, 8 (4) : 359-380. doi: 10.3934/jdg.2021007 [17] Valery Y. Glizer, Oleg Kelis. Singular infinite horizon zero-sum linear-quadratic differential game: Saddle-point equilibrium sequence. Numerical Algebra, Control and Optimization, 2017, 7 (1) : 1-20. doi: 10.3934/naco.2017001 [18] Franco Flandoli, Matti Leimbach. Mean field limit with proliferation. Discrete and Continuous Dynamical Systems - B, 2016, 21 (9) : 3029-3052. doi: 10.3934/dcdsb.2016086 [19] Emiliano Cristiani, Smita Sahu. On the micro-to-macro limit for first-order traffic flow models on networks. Networks and Heterogeneous Media, 2016, 11 (3) : 395-413. doi: 10.3934/nhm.2016002 [20] Abbas Ja'afaru Badakaya, Aminu Sulaiman Halliru, Jamilu Adamu. Game value for a pursuit-evasion differential game problem in a Hilbert space. Journal of Dynamics and Games, 2022, 9 (1) : 1-12. doi: 10.3934/jdg.2021019

2020 Impact Factor: 1.327