Towards Hierarchy–Uniformity Equilibrium: Recovering Semantic Depth in Hypergraph Contrastive Learning
Ruiting Zhao, Ming Li, Lixin Cui, Lu Bai, Feilong Cao, Ke Lv, Pietro Lió
摘要
Hypergraph contrastive learning is an effective paradigm for representation learning on higher-order relational data, yet existing methods largely ignore that hyperedges link nodes with multi-level semantics. Standard contrastive objectives emphasize instance discrimination via hyperspherical uniformity and tend to push embeddings apart in an indiscriminate manner. We show that this leads to a Hierarchy–Uniformity Conflict , whose geometric manifestation is Semantic Flattening , where the semantic depth of hyperedges collapses into a nearly flat cloud of instances. To address this issue, we introduce HyperDepth , a hypergraph contrastive learning framework that moves representations towards a hierarchy–uniformity equilibrium by jointly coordinating spectral and geometric signals. HyperDepth employs a decoupled spectral encoding scheme with adaptive gating so that high-frequency components focus on local instance discrimination while low-frequency components capture global hierarchical structure. On top of this, an energy-based hierarchical Alignment module attaches a learnable prototype tree to the representation space and minimizes an interpretable energy functional to recover the semantic depth of hyperedges. Theoretically, under a mild frequency-separation assumption, we show that the local contrastive and global hierarchical objectives operate on orthogonal spectral components and admit equilibrium embeddings that preserve semantic depth while still retaining instance-level discrimination. Experiments on 15 hypergraph datasets and 17 supervised and self-supervised baselines, spanning homophilic and heterophilic regimes, show that HyperDepth attains strong performance with the best average rank.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper22
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen 等NeurIPS 2020 · 被引用 3,042 次
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 被引用 2,360 次
- Self-supervised Graph-level Representation Learning with Local and Global StructureMinghao Xu, Hang Wang, Bingbing Ni, Hongyu Guo 等ICML 2021 · 被引用 248 次
- Convolutional Neural Networks on Graphs with Chebyshev Approximation, RevisitedMingguo He, Zhewei Wei, Ji-Rong WenNeurIPS 2022 · 被引用 220 次
- You are AllSet: A Multiset Function Framework for Hypergraph Neural NetworksEli Chien, Chao Pan, Jianhao Peng, Olgica MilenkovicICLR 2022 · 被引用 209 次
相关 Paper
- HyperAim: Hypergraph Contrastive Learning with Adaptive Multi-frequency FiltersMing Li, Ruiting Zhao, Zihao Yan, Lu Bai 等AAAI 2026
- HCL: Heterogeneity-Aware Hypergraph Contrastive Learning for Robust Representation LearningKaixuan Yao, Ting Guo, Feilong Cao, Ming LiICML 2026
- Understanding and Mitigating Hyperbolic Dimensional Collapse in Graph Contrastive LearningYifei Zhang, Hao Zhu, Menglin Yang, Jiahong Liu 等KDD 2025 · 被引用 4 次
- Self-Supervised Hypergraph Learning with Substructure Awareness for Hyperedge PredictionMing Li, Huiting Wang, Yuting Chen, Lu Bai 等AAAI 2026
- Heterophily-aware Contrastive Learning for Heterophilic HypergraphsMing Li, Yongqi Li, Yuting Chen, Feilong Cao 等AAAI 2026
