Winformer: Transcending Pairwise Similarity for Time-series Generation
Haoyi Zhou, Xin Xue, Tianyu Chen, lanhao li, Lijun SUN, Jianxin Li
摘要
The periodicity misalignment remains a challenge problem in generating time-series data across multiple domains. The fundamental processing unit of attention in time-series modeling has long been restricted to either individual points or fragmented segments, limiting their ability to capture and adapt to complex periodic patterns inherent in diverse domains. To address this, we introduce Winformer, first to extend this processing unit from individual points to sliding windows, establishing a unified window-wise attention paradigm. Leveraging the adaptive window-alignment kernels derived from the frequency decomposition, Winformer brings semantically richer window representations, and effectively captures and transfers complex periodic patterns across domains. Extensive experiments on 12 real-world datasets demonstrate Winformer's effectiveness, achieving an average performance gain of 10.67% over SOTA baselines.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 被引用 7,289 次
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang 等ICML 2022 · 被引用 2,912 次
- CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series ImputationYusuke Tashiro, Jiaming Song, Yang Song, Stefano ErmonNeurIPS 2021 · 被引用 1,245 次
相关 Paper
- Towards a General Time Series Forecasting Model with Unified Representation and Adaptive TransferYihang Wang, Yuying Qiu, Peng Chen, Kai Zhao 等ICML 2025
- UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series ForecastingXu Liu, Junfeng Hu, Yuan Li, Shizhe Diao 等WWW 2024 · 被引用 198 次
- Domain Adaptation for Time Series Under Feature and Label ShiftsHuan He, Owen Queen, Teddy Koker, Consuelo Cuevas 等ICML 2023 · 被引用 121 次
- InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series ForecastingHaizhou Cao, Zhenhao Huang, Tiechui Yao, Jue Wang 等AAAI 2023 · 被引用 29 次
- Breakthrough Sensor-Limited Single View: Towards Implicit Temporal Dynamics for Time Series Domain AdaptationMingyang Liu, Xinyang Chen, Xiucheng Li, Weili Guan 等NeurIPS 2025
