Diff-MN: Diffusion Parameterized MoE-NCDE for Continuous Time Series Generation with Irregular Observations
Xu Zhang, Junwei Deng, Chang Xu, Hao Li, Jiang Bian
Abstract
Time series generation (TSG) is widely used across domains, yet most existing methods assume regular sampling and fixed output resolutions. These assumptions are often violated in practice, where observations are irregular and sparse, while downstream applications require continuous and high-resolution TS. Although Neural Controlled Differential Equation (NCDE) is promising for modeling irregular TS, it is constrained by a single dynamics function, tightly coupled optimization, and limited ability to adapt learned dynamics to newly generated samples from the generative model. We propose Diff-MN, a continuous TSG framework that enhances NCDE with a Mixture-of-Experts (MoE) dynamics function and a decoupled architectural design for dynamics-focused training. To further enable NCDE to generalize to newly generated samples, Diff-MN employs a diffusion model to parameterize the NCDE temporal dynamics parameters (MoE weights), i.e., jointly learn the distribution of TS data and MoE weights. This design allows sample-specific NCDE parameters to be generated for continuous TS generation. Experiments on ten public and synthetic datasets demonstrate that Diff-MN consistently outperforms strong baselines on both irregular-to-regular and irregular-to-continuous TSG tasks. The code is available at the link https://github.com/microsoft/TimeCraft/tree/main/Diff-MN.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2b849036-6fb8-4953-b6d4-9f5261b64784Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
- GT-GAN: General Purpose Time Series Synthesis with Generative Adversarial NetworksJinsung Jeon, Jeonghak Kim, Haryong Song, Seunghyeon Cho et al.NeurIPS 2022 · 83 citations
- Modeling Continuous Stochastic Processes with Dynamic Normalizing FlowsRuizhi Deng, Bo Chang, Marcus A. Brubaker, Greg Mori et al.NeurIPS 2020 · 62 citations
- Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEsIlan Naiman, N. Benjamin Erichson, Pu Ren, Michael W. Mahoney et al.ICLR 2024 · 49 citations
- Heteroscedastic Temporal Variational Autoencoder For Irregularly Sampled Time SeriesSatya Narayan Shukla, Benjamin M. MarlinICLR 2022 · 29 citations
Related papers
- EXIT: Extrapolation and Interpolation-based Neural Controlled Differential Equations for Time-series Classification and ForecastingSheo Yon Jhin, Jaehoon Lee, Minju Jo, Seungji Kook et al.WWW 2022 · 30 citations
- DIFFODE: Neural ODE with Differentiable Hidden State for Irregular Time Series AnalysisYudong Zhang, Xu Wang, Xuan Yu, Zhengyang Zhou et al.ICDE 2025 · 3 citations
- Dynamic TMoE: A Drift-Aware Dynamic Mixture of Experts Framework for Non-Stationary Time Series ForecastingJiawen Zhu, Shuhan Liu, Di Weng, Yingcai WuICML 2026
- ContiFormer: Continuous-Time Transformer for Irregular Time Series ModelingYuqi Chen, Kan Ren, Yansen Wang, Yuchen Fang et al.NeurIPS 2023 · 131 citations
- Towards a Unified Generative Model for Scarce Time Series with Domain ExpertsZihao Yao, Qi Zheng, Jiankai Zuo, YAYING ZHANGICML 2026
