Sparse Symplectically Integrated Neural Networks
Daniel M. DiPietro, Shiying Xiong, Bo Zhu
Abstract
We introduce Sparse Symplectically Integrated Neural Networks (SSINNs), a novel model for learning Hamiltonian dynamical systems from data. SSINNs combine fourth-order symplectic integration with a learned parameterization of the Hamiltonian obtained using sparse regression through a mathematically elegant function space. This allows for interpretable models that incorporate symplectic inductive biases and have low memory requirements. We evaluate SSINNs on four classical Hamiltonian dynamical problems: the Hénon-Heiles system, nonlinearly coupled oscillators, a multi-particle mass-spring system, and a pendulum system. Our results demonstrate promise in both system prediction and conservation of energy, often outperforming the current state-of-the-art black-box prediction techniques by an order of magnitude. Further, SSINNs successfully converge to true governing equations from highly limited and noisy data, demonstrating potential applicability in the discovery of new physical governing equations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8d3da55f-c560-4e7f-b18e-0dcd80a2cdb1Cited by top-tier papers5
- Neural Symplectic Form: Learning Hamiltonian Equations on General Coordinate SystemsYuhan Chen, Takashi Matsubara, Takaharu YaguchiNeurIPS 2021 · 53 citations
- Nonseparable Symplectic Neural NetworksShiying Xiong, Yunjin Tong, Xingzhe He, Shuqi Yang et al.ICLR 2021 · 47 citations
- Symplectic Spectrum Gaussian Processes: Learning Hamiltonians from Noisy and Sparse DataYusuke Tanaka, Tomoharu Iwata, Naonori UedaNeurIPS 2022 · 16 citations
- SyMetric: Measuring the Quality of Learnt Hamiltonian Dynamics Inferred from VisionIrina Higgins, Peter Wirnsberger, Andrew Jaegle, Aleksandar BotevNeurIPS 2021 · 10 citations
- KAM Theory Meets Statistical Learning Theory: Hamiltonian Neural Networks with Non-zero Training LossYuhan Chen, Takashi Matsubara, Takaharu YaguchiAAAI 2022 · 5 citations
Builds on4
- Plug and Play Language Models: A Simple Approach to Controlled Text GenerationSumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung et al.ICLR 2020 · 1,166 citations
- Discovering Symbolic Models from Deep Learning with Inductive BiasesMiles D. Cranmer, Alvaro Sanchez-Gonzalez, Peter W. Battaglia, Rui Xu et al.NeurIPS 2020 · 736 citations
- Symplectic Recurrent Neural NetworksZhengdao Chen, Jianyu Zhang, Martín Arjovsky, Léon BottouICLR 2020 · 261 citations
- Hamiltonian Generative NetworksPeter Toth, Danilo J. Rezende, Andrew Jaegle, Sébastien Racanière et al.ICLR 2020 · 242 citations
Related papers
- Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic MapsRenyi Chen, Molei TaoICML 2021 · 70 citations
- Weak Form Generalized Hamiltonian LearningKevin Course, Trefor W. Evans, Prasanth B. NairNeurIPS 2020 · 15 citations
- Symplectic ODE-Net: Learning Hamiltonian Dynamics with ControlYaofeng Desmond Zhong, Biswadip Dey, Amit ChakrabortyICLR 2020 · 319 citations
- Learning Hamiltonian Dynamics at Scale: A Differential-Geometric ApproachKatharina Friedl, Noémie Jaquier, Mika Liao, Danica KragicICML 2026
- Stiffness-aware neural network for learning Hamiltonian systemsSenwei Liang, Zhongzhan Huang, Hong ZhangICLR 2022 · 26 citations
