Machine learning structure preserving brackets for forecasting irreversible processes
Kookjin Lee, Nathaniel Trask, Panos Stinis
Abstract
Forecasting of time-series data requires imposition of inductive biases to obtain predictive extrapolation, and recent works have imposed Hamiltonian/Lagrangian form to preserve structure for systems with reversible dynamics. In this work we present a novel parameterization of dissipative brackets from metriplectic dynamical systems appropriate for learning irreversible dynamics with unknown a priori model form. The process learns generalized Casimirs for energy and entropy guaranteed to be conserved and nondecreasing, respectively. Furthermore, for the case of added thermal noise, we guarantee exact preservation of a fluctuation-dissipation theorem, ensuring thermodynamic consistency. We provide benchmarks for dissipative systems demonstrating learned dynamics are more robust and generalize better than either "black-box" or penalty-based approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c77826f3-d156-4f98-8d0a-2a863513652bCited by top-tier papers11
- Parameterized Physics-informed Neural Networks for Parameterized PDEsWoojin Cho, Minju Jo, Haksoo Lim, Kookjin Lee et al.ICML 2024 · 57 citations
- Deconstructing the Inductive Biases of Hamiltonian Neural NetworksNate Gruver, Marc Anton Finzi, Samuel Don Stanton, Andrew Gordon WilsonICLR 2022 · 50 citations
- Learning Physics Constrained Dynamics Using AutoencodersTsung-Yen Yang, Justinian Rosca, Karthik Narasimhan, Peter J. RamadgeNeurIPS 2022 · 39 citations
- Reversible and irreversible bracket-based dynamics for deep graph neural networksAnthony Gruber, Kookjin Lee, Nathaniel TraskNeurIPS 2023 · 30 citations
- Neural Oscillators for Generalization of Physics-Informed Machine LearningTaniya Kapoor, Abhishek Chandra, Daniel M. Tartakovsky, Hongrui Wang et al.AAAI 2024 · 17 citations
Builds on7
- Dissecting Neural ODEsStefano Massaroli, Michael Poli, Jinkyoo Park, Atsushi Yamashita et al.NeurIPS 2020 · 261 citations
- Symplectic Recurrent Neural NetworksZhengdao Chen, Jianyu Zhang, Martín Arjovsky, Léon BottouICLR 2020 · 261 citations
- Hamiltonian Generative NetworksPeter Toth, Danilo J. Rezende, Andrew Jaegle, Sébastien Racanière et al.ICLR 2020 · 242 citations
- Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODEJuntang Zhuang, Nicha C. Dvornek, Xiaoxiao Li, Sekhar Tatikonda et al.ICML 2020 · 125 citations
- Deep Conservation: A Latent-Dynamics Model for Exact Satisfaction of Physical Conservation LawsKookjin Lee, Kevin T. CarlbergAAAI 2021 · 67 citations
Related papers
- Efficiently Parameterized Neural Metriplectic SystemsAnthony Gruber, Kookjin Lee, Haksoo Lim, Noseong Park et al.ICLR 2025
- Symplectic Spectrum Gaussian Processes: Learning Hamiltonians from Noisy and Sparse DataYusuke Tanaka, Tomoharu Iwata, Naonori UedaNeurIPS 2022 · 16 citations
- Sparse Symplectically Integrated Neural NetworksDaniel M. DiPietro, Shiying Xiong, Bo ZhuNeurIPS 2020 · 39 citations
- Physics-Informed Regularization for Domain-Agnostic Dynamical System ModelingZijie Huang, Wanjia Zhao, Jingdong Gao, Ziniu Hu et al.NeurIPS 2024 · 12 citations
- Weak Form Generalized Hamiltonian LearningKevin Course, Trefor W. Evans, Prasanth B. NairNeurIPS 2020 · 15 citations
