Phase2vec: dynamical systems embedding with a physics-informed convolutional network
Matthew Ricci, Noa Moriel, Zoe Piran, Mor Nitzan
Abstract
Dynamical systems are found in innumerable forms across the physical and biological sciences, yet all these systems fall naturally into universal equivalence classes: conservative or dissipative, stable or unstable, compressible or incompressible. Predicting these classes from data remains an essential open challenge in computational physics at which existing time-series classification methods struggle. Here, we propose, phase2vec, an embedding method that learns high-quality, physically-meaningful representations of 2D dynamical systems without supervision. Our embeddings are produced by a convolutional backbone that extracts geometric features from flow data and minimizes a physically-informed vector field reconstruction loss. In an auxiliary training period, embeddings are optimized so that they robustly encode the equations of unseen data over and above the performance of a per-equation fitting method. The trained architecture can not only predict the equations of unseen data, but also, crucially, learns embeddings that respect the underlying semantics of the embedded physical systems. We validate the quality of learned embeddings investigating the extent to which physical categories of input data can be decoded from embeddings compared to standard blackbox classifiers and state-of-the-art time series classification techniques. We find that our embeddings encode important physical properties of the underlying data, including the stability of fixed points, conservation of energy, and the incompressibility of flows, with greater fidelity than competing methods. We finally apply our embeddings to the analysis of meteorological data, showing we can detect climatically meaningful features. Collectively, our results demonstrate the viability of embedding approaches for the discovery of dynamical features in physical systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Generalized Teacher Forcing for Learning Chaotic DynamicsFlorian Hess, Zahra Monfared, Manuel Brenner, Daniel DurstewitzICML 2023 · 67 citations
- Let's do the time-warp-attend: Learning topological invariants of dynamical systemsNoa Moriel, Matthew Ricci, Mor NitzanICLR 2024 · 3 citations
Builds on5
- TapNet: Multivariate Time Series Classification with Attentional Prototypical NetworkXuchao Zhang, Yifeng Gao, Jessica Lin, Chang-Tien LuAAAI 2020 · 363 citations
- Context-aware Dynamics Model for Generalization in Model-Based Reinforcement LearningKimin Lee, Younggyo Seo, Seunghyun Lee, Honglak Lee et al.ICML 2020 · 158 citations
- Generalizing to New Physical Systems via Context-Informed Dynamics ModelMatthieu Kirchmeyer, Yuan Yin, Jérémie Donà, Nicolas Baskiotis et al.ICML 2022 · 54 citations
- LEADS: Learning Dynamical Systems that Generalize Across EnvironmentsYuan Yin, Ibrahim Ayed, Emmanuel de Bézenac, Nicolas Baskiotis et al.NeurIPS 2021 · 54 citations
- High-Dimensional Convolutional Networks for Geometric Pattern RecognitionChristopher B. Choy, Junha Lee, René Ranftl, Jaesik Park et al.CVPR 2020
Related papers
- Poisson-Dirac Neural Networks for Modeling Coupled Dynamical Systems across DomainsRazmik Arman Khosrovian, Takaharu Yaguchi, Hiroaki Yoshimura, Takashi MatsubaraICLR 2025
- Out-of-Domain Generalization in Dynamical Systems ReconstructionNiclas Alexander Göring, Florian Hess, Manuel Brenner, Zahra Monfared et al.ICML 2024 · 31 citations
- Towards Cross Domain Generalization of Hamiltonian Representation via Meta LearningYeongwoo Song, Hawoong JeongICLR 2024 · 4 citations
- Physical Equation Discovery Using Physics-Consistent Neural Network (PCNN) Under Incomplete ObservabilityHaoran Li, Yang WengKDD 2021 · 14 citations
- From Embedding to Control: Representations for Stochastic Multi-Object SystemsXiaoyuan Cheng, Yiming Yang, Wei Jiang, Chenyang Yuan et al.ICLR 2026
