C3RL: Rethinking the Combination of Channel-independence and Channel-mixing from Representation Learning
Shusen Ma, Yunbo Zhao, Yu Kang
摘要
Multivariate time series forecasting has drawn increasing attention due to its practical importance. Existing approaches typically adopt either channel-mixing (CM) or channel-independence (CI) strategies. CM strategy can capture inter-variable dependencies but fails to discern variable-specific temporal patterns. CI strategy improves this aspect but fails to fully exploit cross-variable dependencies like CM. Hybrid strategies based on feature fusion offer limited generalization and interpretability. To address these issues, we propose C3RL, a novel representation learning framework that jointly models both CM and CI strategies. Motivated by contrastive learning in computer vision, C3RL treats the inputs of the two strategies as transposed views and builds a siamese network architecture: one strategy serves as the backbone, while the other complements it. By jointly optimizing contrastive and prediction losses with adaptive weighting, C3RL balances representation and forecasting performance. Extensive experiments on seven models show that C3RL boosts the best-case performance rate to 81.4% for models based on CI strategy and to 76.3% for models based on CM strategy, demonstrating strong generalization and effectiveness.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 被引用 7,289 次
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 被引用 3,619 次
相关 Paper
- From Similarity to Superiority: Channel Clustering for Time Series ForecastingJialin Chen, Jan Eric Lenssen, Aosong Feng, Weihua Hu 等NeurIPS 2024 · 被引用 83 次
- CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series ForecastingGerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar 等ICLR 2022 · 被引用 468 次
- TimeDRL: Disentangled Representation Learning for Multivariate Time-SeriesChing Chang, Chiao-Tung Chan, Wei-Yao Wang, Wen-Chih Peng 等ICDE 2024 · 被引用 21 次
- PatchCLE: Breaking the Linear Representation Bottleneck in Time Series Forecasting via Soft Contrastive LearningMengSen Wu, Haochen Shi, Shengdong Du, Jie Hu 等KDD 2026
- CSformer: Combining Channel Independence and Mixing for Robust Multivariate Time Series ForecastingHaoxin Wang, Yipeng Mo, Kunlan Xiang, Nan Yin 等AAAI 2025 · 被引用 9 次
