Neural Stochastic Differential Games for Time-series Analysis
Sungwoo Park, Byoungwoo Park, Moontae Lee, Changhee Lee
Abstract
Modeling spatiotemporal dynamics with neural differential equations has become a major line of research that opens new ways to handle various real-world scenarios (e.g., missing observations, irregular times, etc.). Despite such progress, most existing methods still face challenges in providing a general framework for analyzing time series. To tackle this, we adopt stochastic differential games to suggest a new philosophy of utilizing interacting collective intelligence in time series analysis. For the implementation, we develop the novel gradient descent-based algorithm called deep neural fictitious play to approximate the Nash equilibrium. We theoretically analyze the convergence result of the proposed algorithm and discuss the advantage of cooperative games in handling noninformative observation. Throughout the experiments on various datasets, we demonstrate the superiority of our framework over all the tested benchmarks in modeling time-series prediction by capitalizing on the advantages of applying cooperative games. An ablation study shows that neural agents of the proposed framework learn intrinsic temporal relevance to make accurate time-series predictions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Decoupled Marked Temporal Point Process using Neural Ordinary Differential EquationsYujee Song, Donghyun Lee, Rui Meng, Won Hwa KimICLR 2024 · 8 citations
- Mean-field Chaos Diffusion ModelsSungwoo Park, Dongjun Kim, Ahmed AlaaICML 2024 · 1 citation
Builds on16
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Reformer: The Efficient TransformerNikita Kitaev, Lukasz Kaiser, Anselm LevskayaICLR 2020 · 2,878 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
Related papers
- Large-Scale Multi-Agent Deep FBSDEsTianrong Chen, Ziyi Wang, Ioannis Exarchos, Evangelos A. TheodorouICML 2021 · 4 citations
- Scalable Deep Reinforcement Learning Algorithms for Mean Field GamesMathieu Laurière, Sarah Perrin, Sertan Girgin, Paul Muller et al.ICML 2022 · 64 citations
- On the Convergence of Model Free Learning in Mean Field GamesRomuald Elie, Julien Pérolat, Mathieu Laurière, Matthieu Geist et al.AAAI 2020 · 101 citations
- Learning While Playing in Mean-Field Games: Convergence and OptimalityQiaomin Xie, Zhuoran Yang, Zhaoran Wang, Andreea MincaICML 2021 · 45 citations
- Team-Fictitious Play for Reaching Team-Nash Equilibrium in Multi-team GamesAhmed Said Donmez, Yuksel Arslantas, Muhammed Omer SayinNeurIPS 2024 · 2 citations
