A Generalizable Physics-Enhanced State Space Model for Long-Term Dynamics Forecasting in Complex Environments
Yuchen Wang, Hongjue Zhao, Haohong Lin, Enze Xu, Lifang He, Huajie Shao
摘要
This work aims to address the problem of longterm dynamic forecasting in complex environments where data are noisy and irregularly sampled. While recent studies have introduced some methods to improve prediction performance, these approaches still face a significant challenge in handling long-term extrapolation tasks under such complex scenarios. To overcome this challenge, we propose Phy-SSM, a generalizable method that integrates partial physics knowledge into state space models (SSMs) for long-term dynamics forecasting in complex environments. Our motivation is that SSMs can effectively capture longrange dependencies in sequential data and model continuous dynamical systems, while the incorporation of physics knowledge improves generalization ability. The key challenge lies in how to seamlessly incorporate partially known physics into SSMs. To achieve this, we decompose partially known system dynamics into known and unknown state matrices, which are integrated into a Phy-SSM unit. To further enhance long-term prediction performance, we introduce a physics state regularization term to make the estimated latent states align with system dynamics. Besides, we theoretically analyze the uniqueness of the solutions for our method. Extensive experiments on three real-world applications, including vehicle motion prediction, drone state prediction, and COVID-19 epidemiology forecasting, demonstrate the superior performance of Phy-SSM over the baselines in both longterm interpolation and extrapolation tasks. The code is available at https://github.com/ 511205787/Phy_SSM-ICML2025 .
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
引用它的顶会 Paper1
它引用的 Paper9
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 3,482 次引用
- HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsAlbert Gu, Tri Dao, Stefano Ermon, Atri Rudra 等NeurIPS 2020 · 1,100 次引用
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 次引用
- Latent Variable Sequential Set Transformers for Joint Multi-Agent Motion PredictionRoger Girgis, Florian Golemo, Felipe Codevilla, Martin Weiss 等ICLR 2022 · 200 次引用
- A Universal Approximation Theorem of Deep Neural Networks for Expressing Probability DistributionsYulong Lu, Jianfeng LuNeurIPS 2020 · 146 次引用
相关 Paper
- Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time SeriesAbdul Fatir Ansari, Alvin Heng, Andre Lim, Harold SohICML 2023 · 29 次引用
- Probabilistic Transformer For Time Series AnalysisBinh Tang, David S. MattesonNeurIPS 2021 · 150 次引用
- Spectral-guided Physical Dynamics DistillationYoujin Kim, Dagyeong Na, Jae Yong Lee, Junseok KwonICLR 2026
- Disentangling Physical Dynamics From Unknown Factors for Unsupervised Video PredictionVincent Le Guen, Nicolas ThomeCVPR 2020
- PINP: Physics-Informed Neural Predictor with latent estimation of fluid flowsHuaguan Chen, Yang Liu, Hao SunICLR 2025
