WeightFlow: Learning Stochastic Dynamics via Evolving Weight of Neural Network
Ruikun Li, Jiazhen Liu, Huandong Wang, Qingmin Liao, Yong Li
Abstract
Modeling stochastic dynamics from discrete observations is a key interdisciplinary challenge. Existing methods often fail to estimate the continuous evolution of probability densities from trajectories or face the curse of dimensionality. To address these limitations, we presents a novel paradigm: modeling dynamics directly in the weight space of a neural network by projecting the evolving probability distribution. We first theoretically establish the connection between dynamic optimal transport in measure space and an equivalent energy functional in weight space. Subsequently, we design WeightFlow, which constructs the neural network weights into a graph and learns its evolution via a graph controlled differential equation. Experiments on interdisciplinary datasets show that WeightFlow improves performance by an average of 43.02% over state-of-the-art methods, providing an effective and scalable solution for modeling high-dimensional stochastic dynamics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on15
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
- TrajectoryNet: A Dynamic Optimal Transport Network for Modeling Cellular DynamicsAlexander Tong, Jessie Huang, Guy Wolf, David van Dijk et al.ICML 2020 · 257 citations
- OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal TransportDerek Onken, Samy Wu Fung, Xingjian Li, Lars RuthottoAAAI 2021 · 210 citations
- Metric Flow Matching for Smooth Interpolations on the Data ManifoldKacper Kapusniak, Peter Potaptchik, Teodora Reu, Leo Zhang et al.NeurIPS 2024 · 89 citations
- Action Matching: Learning Stochastic Dynamics from SamplesKirill Neklyudov, Rob Brekelmans, Daniel Severo, Alireza MakhzaniICML 2023 · 83 citations
Related papers
- Dynamic Topic Models for Temporal Document NetworksDelvin Ce Zhang, Hady W. LauwICML 2022 · 26 citations
- Stochastic Process Learning via Operator Flow MatchingYaozhong Shi, Zachary E. Ross, Domniki Asimaki, Kamyar AzizzadenesheliNeurIPS 2025 · 13 citations
- Neural Markov Controlled SDE: Stochastic Optimization for Continuous-Time DataSung Woo Park, Kyungjae Lee, Junseok KwonICLR 2022 · 35 citations
- Learning Spatiotemporal Dynamical Systems from Point Process ObservationsValerii Iakovlev, Harri LähdesmäkiICLR 2025
- Neural Flows: Efficient Alternative to Neural ODEsMarin Bilos, Johanna Sommer, Syama Sundar Rangapuram, Tim Januschowski et al.NeurIPS 2021 · 151 citations
