PolarFormer: Radial-Angular Latent Modeling for Unconditional Time Series Generation
Jiahong Lyu, Hongfan Gao, Wangmeng Shen, Qingsong Zhong, Jilin Hu
摘要
Time series generation is essential for data augmentation and privacy-preserving analysis across many real-world domains. Recent progress in discrete token modeling (DTM) has demonstrated strong potential by transforming continuous sequences into discrete representations and performing generation in the latent space. However, existing DTM-based methods, particularly VQ-VAE based methods, suffer from imprecise manifold modeling, severe codebook collapse, and high generative complexity caused by entangled latent attributes and heuristic sequence decomposition. In this work, we propose PolarFormer, a novel framework for time series generation that addresses these limitations through a polar decomposition-based discrete representation. Specifically, we decompose continuous latent embeddings into radial and angular components, and model them using two independent codebooks, enabling a multi-layer spherical-shell latent topology that more faithfully captures the underlying data manifold. To stabilize representation learning, we reinterpret VQ-VAE quantization as a Mixture-of-Experts routing process and introduce a load-balancing loss to effectively mitigate codebook collapse. In the generative stage, we further propose a structurally decoupled generation strategy that models radial and angular token sequences jointly while leveraging their orthogonality to substantially reduce modeling complexity. Extensive experiments on multiple datasets demonstrate that PolarFormer consistently achieves state-of-the-art performance in time series generation, validating its effectiveness in representation fidelity and generative quality. Our source code has been made publicly available at https://github.com/decisionintelligence/PolarFormer
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- TimeMar: Multi-Scale Autoregressive Modeling for Unconditional Time Series GenerationXiangyu Xu, Qingsong Zhong, Jilin HuWWW 2026 · 被引用 1 次
- HDT: Hierarchical Discrete Transformer for Multivariate Time Series ForecastingShibo Feng, Peilin Zhao, Liu Liu, Pengcheng Wu 等AAAI 2025 · 被引用 6 次
- SDformer: Similarity-driven Discrete Transformer For Time Series GenerationZhicheng Chen, Shibo Feng, Zhong Zhang, Xi Xiao 等NeurIPS 2024 · 被引用 28 次
- VQ-TR: Vector Quantized Attention for Time Series ForecastingKashif Rasul, Andrew Bennett, Pablo Vicente, Umang Gupta 等ICLR 2024 · 被引用 7 次
- PredToken: Predicting Unknown Tokens and Beyond with Coarse-to-Fine Iterative DecodingXuesong Nie, Haoyuan Jin, Yunfeng Yan, Xi Chen 等CVPR 2024
