Mask the Redundancy: Evolving Masking Representation Learning for Multivariate Time-Series Clustering
Zexi Tan, Xiaopeng Luo, Yunlin Liu, Yiqun Zhang
Abstract
Multivariate Time-Series (MTS) clustering discovers intrinsic grouping patterns of temporal data samples. Although time-series provide rich discriminative information, they also contain substantial redundancy, such as steady-state machine operation records and zero-output periods of solar power generation. Such redundancy diminishes the attention given to discriminative timestamps in representation learning, thus leading to performance bottlenecks in MTS clustering. Masking has been widely adopted to enhance the MTS representation, where temporal reconstruction tasks are designed to capture critical information from MTS. However, most existing masking strategies appear to be standalone preprocessing steps, isolated from the learning process, which hinders dynamic adaptation to the importance of clustering-critical timestamps. Accordingly, this paper proposes the Evolving-masked MTS Clustering (EMTC) method, whose model architecture comprises Importance-aware Variate-wise Masking (IVM) and Multi-Endogenous Views (MEV) generation modules. IVM adaptively guides the model in learning more discriminative representations for clustering, while the reconstruction and cluster-guided contrastive learning pathways enhance and connect the representation learning to clustering tasks. Extensive experiments on 15 benchmark datasets demonstrate the superiority of EMTC over eight SOTA methods, where the EMTC achieves an average improvement of 4.85% in F1-Score over the strongest baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4053843c-646e-41a8-a354-e2dd8d7061cdCited by top-tier papers1
Ask how each one uses itBuilds on14
- TS2Vec: Towards Universal Representation of Time SeriesZhihan Yue, Yujing Wang, Juanyong Duan, Tianmeng Yang et al.AAAI 2022 · 938 citations
- Cluster-Guided Contrastive Graph Clustering NetworkXihong Yang, Yue Liu, Sihang Zhou, Siwei Wang et al.AAAI 2023 · 169 citations
- TSLANet: Rethinking Transformers for Time Series Representation LearningEmadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu et al.ICML 2024 · 159 citations
- UniTS: A Unified Multi-Task Time Series ModelShanghua Gao, Teddy Koker, Owen Queen, Tom Hartvigsen et al.NeurIPS 2024 · 159 citations
- TimesURL: Self-Supervised Contrastive Learning for Universal Time Series Representation LearningJiexi Liu, Songcan ChenAAAI 2024 · 128 citations
Related papers
- MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time SeriesQianwen Meng, Hangwei Qian, Yong Liu, Lizhen Cui et al.AAAI 2023 · 54 citations
- Time-Frequency Augmented Multi-level Contrastive Clustering for Time SeriesCongyu Wang, Mingjing Du, Xiang JiangAAAI 2026
- TimeDRL: Disentangled Representation Learning for Multivariate Time-SeriesChing Chang, Chiao-Tung Chan, Wei-Yao Wang, Wen-Chih Peng et al.ICDE 2024 · 21 citations
- Language Pre-training Guided Masking Representation Learning for Time Series ClassificationLiaoyuan Tang, Zheng Wang, Jie Wang, Guanxiong He et al.AAAI 2025 · 1 citation
- URRL-IMVC: Unified and Robust Representation Learning for Incomplete Multi-View ClusteringGe Teng, Ting Mao, Chen Shen, Xiang Tian et al.KDD 2024 · 3 citations
