Nonlinear Markov games on a finite state space (mean-field and binary interactions)

Article English OPEN
Kolokoltsov, V. N. (Vasiliĭ Nikitich) (2012)

Managing large complex stochastic systems, including competitive interests, when one or several players can control the behavior of a large number of particles (agents, mechanisms, vehicles, subsidiaries, species, police units, etc), say Nk for a player k, the complexity of the game-theoretical (or Markov decision) analysis can become immense as Nk → ∞. However, under rather general assumptions, the limiting problem as all Nk → ∞ can be described by a well manageable deterministic evolution. In this paper we analyze some simple situations of this kind proving the convergence of Nashequilibria for finite games to equilibria of a limiting deterministic differential game.
  • References (16)
    16 references, page 1 of 2

    Andersson, D., & Djehiche, B. (2011). A maximum principle for SDEs of mean-field type. Appl. Math. Optim., 63, 341-356. Belavkin, V. P., & Kolokoltsov, V. N. (2003). On general kinetic equation for many particle systems with interaction, fragmentation and coagulation. Proc. Royal Soc. Lond. A, 459, 727-748. Bogolyubov, N. N. (1946). Problems of the dynamic theory in statistical physics. Moscow, Nauka (in Russian).

    Bordenave, C., McDonald, D., & Proutiere A. (2007). A particle system in interaction with a rapidly varying environment: Mean field limits and applications.

    Buckdahn, R., Djehiche, B., Li, J., & Peng, S. (2009). Mean-field backward stochastic differential equations: a limit approach. Ann. Prob, 37, 1524-1565. Case, J. H. (1967). Toward a Theory of Many Player Differential Games. SIAM Journal on Control, 7, 179-197. Darling, R. W. R., & Norris, J. R. (2008). Differential equation approximations for Markov chains. Probab. Surv., 5, 3779.

    Kushner, H. J. (2002). Numerical approximations for stochastic differential games. SIAM Journal of Control and Optimization, 41, 457-486. Kushner, H. J., & Dupuis, P. (2001). Numerical methods for stochastic control problems in continuous time. 2ed., New York: Springer.

    Lasry, J.-M., & Lions, L. Jeux Champ Moyen. C. R. Math. Acad. Sci. Paris, 343, 619-625 and 679-684.

    Le Boudec, J.-Y., McDonald, D., & Mundinger, J. (2007). A Generic Mean Field Convergence Result for Systems of Interacting Objects. QEST 2007 (4th INternationalConference on Quantitative Evaluation of SysTems), 3-18.

    Leontovich, M. A. (1935). Main equations of the kinetic theory from the point of view of random processes. Journal of Experimantal and Theoretical Physics , 5, 211-231.

    Malafeyev, O. A. (2000). Controlled conflict systems (In Russian). St. Petersburg State University Publication, ISBN 5-288-01769-7.

    Maslov, V. P., & Tariverdiev, C. E. (1982). Asymptotics of the Kolmogorov-Feller equation for systems with the large number of particles. Itogi Nauki i Techniki. Teoriya veroyatnosti, v.19, VINITI, Moscow (in Russian), 85-125.

  • Metrics
    No metrics available
Share - Bookmark