Be More with Less: Hypergraph Attention Networks for Inductive Text Classification
Kaize Ding, Jianling Wang, Jundong Li, Dingcheng Li, Huan Liu
Abstract
Text classification is a critical research topic with broad applications in natural language processing. Recently, graph neural networks (GNNs) have received increasing attention in the research community and demonstrated their promising results on this canonical task. Despite the success, their performance could be largely jeopardized in practice since they are: (1) unable to capture high-order interaction between words; (2) inefficient to handle large datasets and new documents. To address those issues, in this paper, we propose a principled model -hypergraph attention networks (HyperGAT), which can obtain more expressive power with less computational consumption for text representation learning. Extensive experiments on various benchmark datasets demonstrate the efficacy of the proposed approach on the text classification task.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers27
- You are AllSet: A Multiset Function Framework for Hypergraph Neural NetworksEli Chien, Chao Pan, Jianhao Peng, Olgica MilenkovicICLR 2022 · 209 citations
- MS-HGAT: Memory-Enhanced Sequential Hypergraph Attention Network for Information Diffusion PredictionLing Sun, Yuan Rao, Xiangbo Zhang, Yuqian Lan et al.AAAI 2022 · 86 citations
- Deep Attention Diffusion Graph Neural Networks for Text ClassificationYonghao Liu, Renchu Guan, Fausto Giunchiglia, Yanchun Liang et al.EMNLP 2021 · 67 citations
- Learning Causal Effects on HypergraphsJing Ma, Mengting Wan, Longqi Yang, Jundong Li et al.KDD 2022 · 61 citations
- Sparse Structure Learning via Graph Neural Networks for Inductive Document ClassificationYinhua Piao, Sangseon Lee, Dohoon Lee, Sun KimAAAI 2022 · 46 citations
Builds on2
Related papers
- HONGAT: Graph Attention Networks in the Presence of High-Order NeighborsHeng-Kai Zhang, Yi-Ge Zhang, Zhi Zhou, Yufeng LiAAAI 2024 · 15 citations
- Hyper-SAGNN: a self-attention based graph neural network for hypergraphsRuochi Zhang, Yuesong Zou, Jian MaICLR 2020 · 228 citations
- Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLPLukas Galke, Ansgar ScherpACL 2022
- Training-Free Message Passing for Learning on HypergraphsBohan Tang, Zexi Liu, Keyue Jiang, Siheng Chen et al.ICLR 2025
- Defining and Discovering Hyper-meta-paths for Heterogeneous HypergraphsYaming Yang, Ziyu Zheng, Weigang Lu, Zhe Wang et al.NeurIPS 2025
