Generalizing to New Physical Systems via Context-Informed Dynamics Model
Matthieu Kirchmeyer, Yuan Yin, Jérémie Donà, Nicolas Baskiotis, Alain Rakotomamonjy, Patrick Gallinari
Abstract
Data-driven approaches to modeling physical systems fail to generalize to unseen systems that share the same general dynamics with the learning domain, but correspond to different physical contexts. We propose a new framework for this key problem, context-informed dynamics adaptation (CoDA), which takes into account the distributional shift across systems for fast and efficient adaptation to new dynamics. CoDA leverages multiple environments, each associated to a different dynamic, and learns to condition the dynamics model on contextual parameters, specific to each environment. The conditioning is performed via a hypernetwork, learned jointly with a context vector from observed data. The proposed formulation constrains the search hypothesis space to foster fast adaptation and better generalization across environments. We theoretically motivate our approach and show state-of-the-art generalization results on a set of nonlinear dynamics, representative of a variety of application domains. We also show, on these systems, that new system parameters can be inferred from context vectors with minimal supervision. Code is available at https://github.com/yuan-yin/CoDA .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers34
- Generalized Teacher Forcing for Learning Chaotic DynamicsFlorian Hess, Zahra Monfared, Manuel Brenner, Daniel DurstewitzICML 2023 · 67 citations
- Training neural operators to preserve invariant measures of chaotic attractorsRuoxi Jiang, Peter Y. Lu, Elena Orlova, Rebecca WillettNeurIPS 2023 · 59 citations
- Out-of-Domain Generalization in Dynamical Systems ReconstructionNiclas Alexander Göring, Florian Hess, Manuel Brenner, Zahra Monfared et al.ICML 2024 · 31 citations
- True Zero-Shot Inference of Dynamical Systems Preserving Long-Term StatisticsChristoph Jürgen Hemmer, Daniel DurstewitzNeurIPS 2025 · 25 citations
- PURE: Prompt Evolution with Graph ODE for Out-of-distribution Fluid Dynamics ModelingHao Wu, Changhu Wang, Fan Xu, Jinbao Xue et al.NeurIPS 2024 · 23 citations
Builds on12
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Distributionally Robust Neural NetworksShiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, Percy LiangICLR 2020 · 1,578 citations
- Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLAniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol VinyalsICLR 2020 · 736 citations
- Symplectic Recurrent Neural NetworksZhengdao Chen, Jianyu Zhang, Martín Arjovsky, Léon BottouICLR 2020 · 261 citations
- Meta-Learning with Warped Gradient DescentSebastian Flennerhag, Andrei A. Rusu, Razvan Pascanu, Francesco Visin et al.ICLR 2020 · 221 citations
Related papers
- LEADS: Learning Dynamical Systems that Generalize Across EnvironmentsYuan Yin, Ibrahim Ayed, Emmanuel de Bézenac, Nicolas Baskiotis et al.NeurIPS 2021 · 54 citations
- Generalizing Graph ODE for Learning Complex System Dynamics across EnvironmentsZijie Huang, Yizhou Sun, Wei WangKDD 2023 · 16 citations
- CODA: Generalizing to Open and Unseen Domains with Compaction and DisambiguationChaoqi Chen, Luyao Tang, Yue Huang, Xiaoguang Han et al.NeurIPS 2023 · 17 citations
- HyperDynamics: Meta-Learning Object and Agent Dynamics with HypernetworksZhou Xian, Shamit Lal, Hsiao-Yu Tung, Emmanouil Antonios Platanios et al.ICLR 2021 · 32 citations
- Neural Context Flows for Meta-Learning of Dynamical SystemsRoussel Desmond Nzoyem, David A. W. Barton, Tom DeakinICLR 2025
