Meta-learning Structure-Preserving Dynamics
Cheng Jing, Uvini Mudiyanselage, Woojin Cho, Minju Jo, Anthony Gruber, Kookjin Lee
Abstract
Structure-preserving approaches to dynamics discovery have demonstrated great potential for modeling physical systems due to their use of strong inductive biases, which enforce key features such as conservation laws and dissipative behavior. However, these models are typically trained on a per-configuration basis, requiring explicit knowledge of system parameters and costly retraining when these parameters vary. While meta-learning provides a potential remedy, optimization-based approaches can suffer from limited generalizability. Motivated by recent advances in modulation-based learning aimed at mitigating these drawbacks, we systematically investigate the use of modulation techniques in learning conservative dynamical systems. We study a range of existing modulation strategies alongside newly proposed variants, integrating them into a Hamiltonian learning framework without requiring an explicit system parameterization. Through extensive experiments on benchmark problems, we demonstrate that modulation-based meta-learning enables accurate few-shot adaptation, achieving robust generalization across parameter space without compromising the conservation of key invariants responsible for the dynamics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6f823c0b-ee51-4fdb-b04e-5f506de684c5Builds on19
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLAniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol VinyalsICLR 2020 · 736 citations
- Symplectic ODE-Net: Learning Hamiltonian Dynamics with ControlYaofeng Desmond Zhong, Biswadip Dey, Amit ChakrabortyICLR 2020 · 319 citations
- Symplectic Recurrent Neural NetworksZhengdao Chen, Jianyu Zhang, Martín Arjovsky, Léon BottouICLR 2020 · 261 citations
- Hamiltonian Generative NetworksPeter Toth, Danilo J. Rezende, Andrew Jaegle, Sébastien Racanière et al.ICLR 2020 · 242 citations
Related papers
- Identifying Physical Law of Hamiltonian Systems via Meta-LearningSeungjun Lee, Haesang Yang, Woojae SeongICLR 2021 · 14 citations
- Towards Cross Domain Generalization of Hamiltonian Representation via Meta LearningYeongwoo Song, Hawoong JeongICLR 2024 · 4 citations
- MetaPhysiCa: Improving OOD Robustness in Physics-informed Machine LearningS. Chandra Mouli, Muhammad Ashraful Alam, Bruno RibeiroICLR 2024 · 5 citations
- Machine learning structure preserving brackets for forecasting irreversible processesKookjin Lee, Nathaniel Trask, Panos StinisNeurIPS 2021 · 80 citations
- Interpretable Meta-Learning of Physical SystemsMatthieu Blanke, Marc LelargeICLR 2024 · 10 citations
