TimeMar: Multi-Scale Autoregressive Modeling for Unconditional Time Series Generation
Xiangyu Xu, Qingsong Zhong, Jilin Hu
Abstract
Generative modeling offers a promising solution to data scarcity and privacy challenges in time series analysis. However, the structural complexity of time series, characterized by multi-scale temporal patterns and heterogeneous components, remains insufficiently addressed. In this work, we propose a structure-disentangled multiscale generation framework for time series. Our approach encodes sequences into discrete tokens at multiple temporal resolutions and performs autoregressive generation in a coarse-to-fine manner, thereby preserving hierarchical dependencies. To tackle structural heterogeneity, we introduce a dual-path VQ-VAE that disentangles trend and seasonal components, enabling the learning of semantically consistent latent representations. Additionally, we present a guidance-based reconstruction strategy, where coarse seasonal signals are utilized as priors to guide the reconstruction of fine-grained seasonal patterns. Experiments on six datasets show that our approach produces higher-quality time series than existing methods. Notably, our model achieves strong performance with a significantly reduced parameter count and exhibits superior capability in generating high-quality long-term sequences. Our implementation is available at https://anonymous.4open.science/r/TimeMAR-BC5B . CCS Concepts • Computing methodologies → Machine learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2f81f998-ea5f-4846-9009-86b0a5ac0e5aBuilds on33
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- DiffWave: A Versatile Diffusion Model for Audio SynthesisZhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao et al.ICLR 2021 · 1,902 citations
- Generative Pretraining From PixelsMark Chen, Alec Radford, Rewon Child, Jeffrey Wu et al.ICML 2020 · 1,773 citations
Related papers
- PolarFormer: Radial-Angular Latent Modeling for Unconditional Time Series GenerationJiahong Lyu, Hongfan Gao, Wangmeng Shen, Qingsong Zhong et al.KDD 2026 · 1 citation
- HDT: Hierarchical Discrete Transformer for Multivariate Time Series ForecastingShibo Feng, Peilin Zhao, Liu Liu, Pengcheng Wu et al.AAAI 2025 · 6 citations
- MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse ObservationsYuhua Luo, Junsheng Zhang, Mengyin Liu, Xincheng Lin et al.ICML 2026
- Generative Time Series Forecasting with Diffusion, Denoise, and DisentanglementYan Li, Xinjiang Lu, Yaqing Wang, Dejing DouNeurIPS 2022 · 203 citations
- Learning Latent Seasonal-Trend Representations for Time Series ForecastingZhiyuan Wang, Xovee Xu, Weifeng Zhang, Goce Trajcevski et al.NeurIPS 2022 · 108 citations
