Role Hypergraph Contrastive Learning for Multivariate Time-Series Analysis
Rundong Xue, Hao Hu, Zhitao Zeng, Xiangmin Han, Zhiqiang Tian, Shaoyi Du, Yue Gao
Abstract
Multivariate Time-Series (MTS) analysis is crucial across various domains. Considering the spatial and temporal consistency of MTS, existing methods leverage graph structures with temporal augmentation and contrastive learning to achieve robust learning of spatial dependencies and temporal patterns. Given the inherent high-order correlations in MTS, hypergraphs present a promising approach. However, two key challenges limit their further development: 1) Feature-based perspectives capture limited spatial information, while structural perspectives encode richer spatial consistency and evolution dependency; 2) Various semantic patterns (e.g., synergy, inhibition) entangle in sensor correlations, leading to semantic ambiguity. The underlying reason is that conventional hypergraph structures cannot distinguish specific semantic roles within or across hyperedges. Thus, we propose Role Hypergraph Contrastive Learning for MTS analysis. Specifically, we introduce the concept of role to generalize hypergraphs to Role Hypergraphs, enabling precise modeling of sensor correlations by assigning each vertex-hyperedge pair with a semantic role. Building on this structure, we design a role hypergraph contrastive learning paradigm to comprehensively capture the spatial and temporal dependencies: From a structural perspective, role hypergraph structural contrasting captures spatial short-term consistency and long-term evolution; from a feature perspective, alignment of complementary role information ensures sensor-level temporal consistency. Experiments on classification and forecasting tasks demonstrate the effectiveness and interpretability of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ade6df83-d104-4668-869e-182113bfebb8Builds on22
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
Related papers
- Graph-Aware Contrasting for Multivariate Time-Series ClassificationYucheng Wang, Yuecong Xu, Jianfei Yang, Min Wu et al.AAAI 2024 · 42 citations
- Hypergraph-Based Multi-View Multi-Label Classification via Adaptive High-Order Semantic FusionYi Shan, Liyang Gao, Yuena Lin, Zhen Yang et al.AAAI 2026
- Representation Learning of Temporal Graphs with Structural RolesHuaming Du, Long Shi, Xingyan Chen, Yu Zhao et al.KDD 2024 · 3 citations
- Learning Time-Aware Graph Structures for Spatially Correlated Time Series ForecastingMinbo Ma, Jilin Hu, Christian S. Jensen, Fei Teng et al.ICDE 2024 · 21 citations
- Ada-MSHyper: Adaptive Multi-Scale Hypergraph Transformer for Time Series ForecastingZongjiang Shang, Ling Chen, Binqing Wu, Dongliang CuiNeurIPS 2024 · 49 citations
