Winformer: Transcending Pairwise Similarity for Time-series Generation
Haoyi Zhou, Xin Xue, Tianyu Chen, lanhao li, Lijun SUN, Jianxin Li
Abstract
The periodicity misalignment remains a challenge problem in generating time-series data across multiple domains. The fundamental processing unit of attention in time-series modeling has long been restricted to either individual points or fragmented segments, limiting their ability to capture and adapt to complex periodic patterns inherent in diverse domains. To address this, we introduce Winformer, first to extend this processing unit from individual points to sliding windows, establishing a unified window-wise attention paradigm. Leveraging the adaptive window-alignment kernels derived from the frequency decomposition, Winformer brings semantically richer window representations, and effectively captures and transfers complex periodic patterns across domains. Extensive experiments on 12 real-world datasets demonstrate Winformer's effectiveness, achieving an average performance gain of 10.67% over SOTA baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on15
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series ImputationYusuke Tashiro, Jiaming Song, Yang Song, Stefano ErmonNeurIPS 2021 · 1,245 citations
Related papers
- Towards a General Time Series Forecasting Model with Unified Representation and Adaptive TransferYihang Wang, Yuying Qiu, Peng Chen, Kai Zhao et al.ICML 2025
- UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series ForecastingXu Liu, Junfeng Hu, Yuan Li, Shizhe Diao et al.WWW 2024 · 198 citations
- Domain Adaptation for Time Series Under Feature and Label ShiftsHuan He, Owen Queen, Teddy Koker, Consuelo Cuevas et al.ICML 2023 · 121 citations
- InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series ForecastingHaizhou Cao, Zhenhao Huang, Tiechui Yao, Jue Wang et al.AAAI 2023 · 29 citations
- Breakthrough Sensor-Limited Single View: Towards Implicit Temporal Dynamics for Time Series Domain AdaptationMingyang Liu, Xinyang Chen, Xiucheng Li, Weili Guan et al.NeurIPS 2025
