Differential-Aware Synergy of Quantity and Topology for Hyper-Relational Knowledge Graphs with Numeric Entities
Ming Yin, Neng Gao
Abstract
Representation learning on hyper-relational numeric knowledge graphs (HNKGs), which incorporate numeric entities and facts consisting of a primary triple augmented by attribute-value qualifiers, is crucial for advanced reasoning. However, most existing methods employ discretization or binning strategies, struggling to consider physical quantities in modeling numeric entities: neglecting numeric continuity (e.g., 100 is greater than 1) and numeric polysemy (e.g., 80 represent age or weight without unit), leading to feature entanglement between numeric semantics and topological structures. In this predicament, standard attention mechanisms—limited by the inherent nature of positive-only accumulation (i.e., non-negative weights)-fail to peel away quantitative noise, forcing models into a compromised balance. To address these challenges, we propose NumDAE—a novel differential-aware decouple-then-synergize embedding framework for HNKGs. We reconstruct numeric semantics based on the relational context to endow numeric entities with algebraic computability, effectively decoupling pure physical quantity from the entangled topological background. Simultaneously, we design a differential-aware embedding transformer to effectively aggregate the semantic and structural representations, utilizing a subtractive cancellation between signal and noise attention maps to avoid mutual interference arising from the misalignment, achieving a high-fidelity synergy. Extensive experiments on public HNKG benchmarks demonstrate that NumDAE outperforms competitive baselines on link, relation and numeric value prediction tasks.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 37763d59-5bd8-4ebc-82aa-af1de2f4e600Related papers
- Hyper-Relational Knowledge Representation Learning with Multi-Hypergraph DisentanglementJiecheng Li, Xudong Luo, Guangquan Lu, Shichao ZhangWWW 2025 · 4 citations
- NumCoKE: Ordinal-Aware Numerical Reasoning over Knowledge Graphs with Mixture-of-Experts and Contrastive LearningMing Yin, Zongsheng Cao, Qiqing Xia, Chenyang Tu et al.AAAI 2026 · 1 citation
- Representation Learning on Hyper-Relational and Numeric Knowledge Graphs with TransformersChanyoung Chung, Jaejun Lee, Joyce Jiyoung WhangKDD 2023 · 14 citations
- Complex Numerical Reasoning with Numerical Semantic Pre-training FrameworkJun Zhang, Haihong E, Tianyi Hu, Yifan Zhu et al.EMNLP 2025
- Query Embedding on Hyper-Relational Knowledge GraphsDimitrios Alivanistos, Max Berrendorf, Michael Cochez, Mikhail GalkinICLR 2022 · 29 citations
