Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps
Renyi Chen, Molei Tao
Abstract
We consider the learning and prediction of nonlinear time series generated by a latent symplectic map. A special case is (not necessarily separable) Hamiltonian systems, whose solution flows give such symplectic maps. For this special case, both generic approaches based on learning the vector field of the latent ODE and specialized approaches based on learning the Hamiltonian that generates the vector field exist. Our method, however, is different as it does not rely on the vector field nor assume its existence; instead, it directly learns the symplectic evolution map in discrete time. Moreover, we do so by representing the symplectic map via a generating function, which we approximate by a neural network (hence the name GFNN). This way, our approximation of the evolution map is always exactly symplectic. This additional geometric structure allows the local prediction error at each step to accumulate in a controlled fashion, and we will prove, under reasonable assumptions, that the global prediction error grows at most linearly with long prediction time, which significantly improves an otherwise exponential growth. In addition, as a map-based and thus purely data-driven method, GFNN avoids two additional sources of inaccuracies common in vector-field based approaches, namely the error in approximating the vector field by finite difference of the data, and the error in numerical integration of the vector field for making predictions. Numerical experiments further demonstrate our claims.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e3f17592-9a09-4069-bd2c-437506d2bd1fCited by top-tier papers9
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise AttentionRomain Ilbert, Ambroise Odonnat, Vasilii Feofanov, Aladin Virmaux et al.ICML 2024 · 62 citations
- Neural Symplectic Form: Learning Hamiltonian Equations on General Coordinate SystemsYuhan Chen, Takashi Matsubara, Takaharu YaguchiNeurIPS 2021 · 53 citations
- On Numerical Integration in Neural Ordinary Differential EquationsAiqing Zhu, Pengzhan Jin, Beibei Zhu, Yifa TangICML 2022 · 33 citations
- Reversible and irreversible bracket-based dynamics for deep graph neural networksAnthony Gruber, Kookjin Lee, Nathaniel TraskNeurIPS 2023 · 30 citations
Builds on4
- Symplectic ODE-Net: Learning Hamiltonian Dynamics with ControlYaofeng Desmond Zhong, Biswadip Dey, Amit ChakrabortyICLR 2020 · 319 citations
- Symplectic Recurrent Neural NetworksZhengdao Chen, Jianyu Zhang, Martín Arjovsky, Léon BottouICLR 2020 · 261 citations
- Hamiltonian Generative NetworksPeter Toth, Danilo J. Rezende, Andrew Jaegle, Sébastien Racanière et al.ICLR 2020 · 242 citations
- Nonseparable Symplectic Neural NetworksShiying Xiong, Yunjin Tong, Xingzhe He, Shuqi Yang et al.ICLR 2021 · 47 citations
Related papers
- Sparse Symplectically Integrated Neural NetworksDaniel M. DiPietro, Shiying Xiong, Bo ZhuNeurIPS 2020 · 39 citations
- Learning Efficient and Robust Ordinary Differential Equations via Invertible Neural NetworksWeiming Zhi, Tin Lai, Lionel Ott, Edwin V. Bonilla et al.ICML 2022 · 26 citations
- Symplectic Spectrum Gaussian Processes: Learning Hamiltonians from Noisy and Sparse DataYusuke Tanaka, Tomoharu Iwata, Naonori UedaNeurIPS 2022 · 16 citations
- Learning Hamiltonian Dynamics at Scale: A Differential-Geometric ApproachKatharina Friedl, Noémie Jaquier, Mika Liao, Danica KragicICML 2026
- Weak Form Generalized Hamiltonian LearningKevin Course, Trefor W. Evans, Prasanth B. NairNeurIPS 2020 · 15 citations
