Context-Informed Neural ODEs Unexpectedly Identify Broken Symmetries: Insights from the Poincaré-Hopf Theorem
In Huh, Changwook Jeong, Muhammad Alam
Abstract
Out-Of-Domain (OOD) generalization is a significant challenge in learning dynamical systems, especially when they exhibit bifurcation, a sudden topological transition triggered by a model parameter crossing a critical threshold. A prevailing belief is that machine learning models, unless equipped with strong priors, struggle to generalize across bifurcations due to the abrupt changes in data characteristics. Contrary to this belief, we demonstrate that context-dependent Neural Ordinary Differential Equations (NODEs), trained solely on localized, pre-bifurcation, symmetric data and without physics-based priors, can still identify post-bifurcation, symmetry-breaking behaviors, even in a zero-shot manner. We interpret this capability to the model’s implicit utilization of topological invariants, particularly the Poincaré index, and offer a formal explanation based on the Poincaré–Hopf theorem. We derive the conditions under which NODEs can recover—or erroneously hallucinate—broken symmetries without explicit training. Building on this insight, we showcase a topological regularizer inspired by the Poincaré–Hopf theorem and validate it empirically on phase transitions of systems described by the Landau–Khalatnikov equation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1276bb36-0dca-4f9c-80c7-2dc2623d1099Cited by top-tier papers1
Ask how each one uses itBuilds on14
- Augmenting Physical Models with Deep Networks for Complex Dynamics ForecastingYuan Yin, Vincent Le Guen, Jérémie Donà, Emmanuel de Bézenac et al.ICLR 2021 · 165 citations
- Towards a Theoretical Framework of Out-of-Distribution GeneralizationHaotian Ye, Chuanlong Xie, Tianle Cai, Ruichen Li et al.NeurIPS 2021 · 159 citations
- Spontaneous symmetry breaking in generative diffusion modelsGabriel Raya, Luca AmbrogioniNeurIPS 2023 · 93 citations
- Benchmarking Deep Inverse Models over time, and the Neural-Adjoint methodSimiao Ren, Willie Padilla, Jordan M. MalofNeurIPS 2020 · 57 citations
- Generalizing to New Physical Systems via Context-Informed Dynamics ModelMatthieu Kirchmeyer, Yuan Yin, Jérémie Donà, Nicolas Baskiotis et al.ICML 2022 · 54 citations
Related papers
- Let's do the time-warp-attend: Learning topological invariants of dynamical systemsNoa Moriel, Matthew Ricci, Mor NitzanICLR 2024 · 3 citations
- Sparsity in Continuous-Depth Neural NetworksHananeh Aliee, Till Richter, Mikhail Solonin, Ignacio Ibarra et al.NeurIPS 2022 · 21 citations
- Out-of-Domain Generalization in Dynamical Systems ReconstructionNiclas Alexander Göring, Florian Hess, Manuel Brenner, Zahra Monfared et al.ICML 2024 · 31 citations
- Neural Context Flows for Meta-Learning of Dynamical SystemsRoussel Desmond Nzoyem, David A. W. Barton, Tom DeakinICLR 2025
- TRENDy: Temporal Regression of Effective Nonlinear DynamicsMatthew Ricci, Guy Pelc, Zoe Piran, Noa Moriel et al.ICLR 2025
