Signatured Deep Fictitious Play for Mean Field Games with Common Noise
Ming Min, Ruimeng Hu
Abstract
Existing deep learning methods for solving mean-field games (MFGs) with common noise fix the sampling common noise paths and then solve the corresponding MFGs. This leads to a nested-loop structure with millions of simulations of common noise paths in order to produce accurate solutions, which results in prohibitive computational cost and limits the applications to a large extent. In this paper, based on the rough path theory, we propose a novel single-loop algorithm, named signatured deep fictitious play, by which we can work with the unfixed common noise setup to avoid the nested-loop structure and reduce the computational complexity significantly. The proposed algorithm can accurately capture the effect of common uncertainty changes on mean-field equilibria without further training of neural networks, as previously needed in the existing machine learning algorithms. The efficiency is supported by three applications, including linear-quadratic MFGs, mean-field portfolio game, and mean-field game of optimal consumption and investment. Overall, we provide a new point of view from the rough path theory to solve MFGs with common noise with significantly improved efficiency and an extensive range of applications. In addition, we report the first deep learning work to deal with extended MFGs (a mean-field interaction via both the states and controls) with common noise.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6407b7fb-0e13-4cc3-9450-4e0472283022Cited by top-tier papers3
- Learning Mean Field Games on Sparse Graphs: A Hybrid Graphex ApproachChristian Fabian, Kai Cui, Heinz KoepplICLR 2024 · 5 citations
- Neural Stochastic Differential Games for Time-series AnalysisSungwoo Park, Byoungwoo Park, Moontae Lee, Changhee LeeICML 2023 · 3 citations
- Directed Chain Generative Adversarial NetworksMing Min, Ruimeng Hu, Tomoyuki IchibaICML 2023 · 2 citations
Builds on4
- Fictitious Play for Mean Field Games: Continuous Time Analysis and ApplicationsSarah Perrin, Julien Pérolat, Mathieu Laurière, Matthieu Geist et al.NeurIPS 2020 · 150 citations
- On the Convergence of Model Free Learning in Mean Field GamesRomuald Elie, Julien Pérolat, Mathieu Laurière, Matthieu Geist et al.AAAI 2020 · 101 citations
- Signatory: differentiable computations of the signature and logsignature transforms, on both CPU and GPUPatrick Kidger, Terry J. LyonsICLR 2021 · 97 citations
- Bayesian Learning from Sequential Data using Gaussian Processes with Signature CovariancesCsaba Tóth, Harald OberhauserICML 2020 · 40 citations
Related papers
- Large-Scale Multi-Agent Deep FBSDEsTianrong Chen, Ziyi Wang, Ioannis Exarchos, Evangelos A. TheodorouICML 2021 · 4 citations
- Population-Aware Imitation Learning in Mean-field Games with Common NoiseGrégoire Lambrecht, Mathieu LauriereICML 2026
- Learning Discrete-Time Major-Minor Mean Field GamesKai Cui, Gökçe Dayanikli, Mathieu Laurière, Matthieu Geist et al.AAAI 2024 · 5 citations
- Scalable Deep Reinforcement Learning Algorithms for Mean Field GamesMathieu Laurière, Sarah Perrin, Sertan Girgin, Paul Muller et al.ICML 2022 · 64 citations
- Solving Continuous Mean Field Games: Deep Reinforcement Learning for Non-Stationary DynamicsLorenzo Magnino, Kai Shao, Zida Wu, Jiacheng Shen et al.NeurIPS 2025 · 4 citations
