Towards Hierarchy–Uniformity Equilibrium: Recovering Semantic Depth in Hypergraph Contrastive Learning
Ruiting Zhao, Ming Li, Lixin Cui, Lu Bai, Feilong Cao, Ke Lv, Pietro Lió
Abstract
Hypergraph contrastive learning is an effective paradigm for representation learning on higher-order relational data, yet existing methods largely ignore that hyperedges link nodes with multi-level semantics. Standard contrastive objectives emphasize instance discrimination via hyperspherical uniformity and tend to push embeddings apart in an indiscriminate manner. We show that this leads to a Hierarchy–Uniformity Conflict , whose geometric manifestation is Semantic Flattening , where the semantic depth of hyperedges collapses into a nearly flat cloud of instances. To address this issue, we introduce HyperDepth , a hypergraph contrastive learning framework that moves representations towards a hierarchy–uniformity equilibrium by jointly coordinating spectral and geometric signals. HyperDepth employs a decoupled spectral encoding scheme with adaptive gating so that high-frequency components focus on local instance discrimination while low-frequency components capture global hierarchical structure. On top of this, an energy-based hierarchical Alignment module attaches a learnable prototype tree to the representation space and minimizes an interpretable energy functional to recover the semantic depth of hyperedges. Theoretically, under a mild frequency-separation assumption, we show that the local contrastive and global hierarchical objectives operate on orthogonal spectral components and admit equilibrium embeddings that preserve semantic depth while still retaining instance-level discrimination. Experiments on 15 hypergraph datasets and 17 supervised and self-supervised baselines, spanning homophilic and heterophilic regimes, show that HyperDepth attains strong performance with the best average rank.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on22
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 2,360 citations
- Self-supervised Graph-level Representation Learning with Local and Global StructureMinghao Xu, Hang Wang, Bingbing Ni, Hongyu Guo et al.ICML 2021 · 248 citations
- Convolutional Neural Networks on Graphs with Chebyshev Approximation, RevisitedMingguo He, Zhewei Wei, Ji-Rong WenNeurIPS 2022 · 220 citations
- You are AllSet: A Multiset Function Framework for Hypergraph Neural NetworksEli Chien, Chao Pan, Jianhao Peng, Olgica MilenkovicICLR 2022 · 209 citations
Related papers
- HyperAim: Hypergraph Contrastive Learning with Adaptive Multi-frequency FiltersMing Li, Ruiting Zhao, Zihao Yan, Lu Bai et al.AAAI 2026
- HCL: Heterogeneity-Aware Hypergraph Contrastive Learning for Robust Representation LearningKaixuan Yao, Ting Guo, Feilong Cao, Ming LiICML 2026
- Understanding and Mitigating Hyperbolic Dimensional Collapse in Graph Contrastive LearningYifei Zhang, Hao Zhu, Menglin Yang, Jiahong Liu et al.KDD 2025 · 4 citations
- Self-Supervised Hypergraph Learning with Substructure Awareness for Hyperedge PredictionMing Li, Huiting Wang, Yuting Chen, Lu Bai et al.AAAI 2026
- Heterophily-aware Contrastive Learning for Heterophilic HypergraphsMing Li, Yongqi Li, Yuting Chen, Feilong Cao et al.AAAI 2026
