Lune

ACL Findings2023

Enhancing Hierarchical Text Classification through Knowledge Graph Integration

Ye Liu, Kai Zhang, Zhenya Huang, Kehang Wang, Yanghai Zhang, Qi Liu, Enhong Chen

Abstract

Hierarchical Text Classification (HTC) is an essential and challenging subtask of multi-label text classification with a taxonomic hierarchy. Recent advances in deep learning and pretrained language models have led to significant breakthroughs in the HTC problem. However, despite their effectiveness, these methods are often restricted by a lack of domain knowledge, which leads them to make mistakes in a variety of situations. Generally, when manually classifying a specific document to the taxonomic hierarchy, experts make inference based on their prior knowledge and experience. For machines to achieve this capability, we propose a novel Knowledge-enabled Hierarchical Text Classification model (K-HTC), which incorporates knowledge graphs into HTC. Specifically, K-HTC innovatively integrates knowledge into both the text representation and hierarchical label learning process, addressing the knowledge limitations of traditional methods. Additionally, a novel knowledge-aware contrastive learning strategy is proposed to further exploit the information inherent in the data. Extensive experiments on two publicly available HTC datasets show the efficacy of our proposed method, and indicate the necessity of incorporating knowledge graphs in HTC tasks.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification cites Hierarchy-Aware Global Model for Hierarchical Text Classification
  • Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification cites Hierarchy-aware Label Semantics Matching Network for Hierarchical Text Classification
  • OneNet: A Fine-Tuning Free Framework for Few-Shot Entity Linking via Large Language Model Prompting cites Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis
  • Hierarchy-aware Label Semantics Matching Network for Hierarchical Text Classification cites Hierarchy-Aware Global Model for Hierarchical Text Classification
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. OneNet: A Fine-Tuning Free Framework for Few-Shot Entity Linking via Large Language Model PromptingXukai Liu, Ye Liu, Kai Zhang, Kehang Wang et al.EMNLP 2024 · 7 citations

Builds on4

  1. Hierarchy-Aware Global Model for Hierarchical Text ClassificationJie Zhou, Chunping Ma, Dingkun Long, Guangwei Xu et al.ACL 2020 · 171 citations
  2. Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text ClassificationZihan Wang, Peiyi Wang, Lianzhe Huang, Xin Sun et al.ACL 2022 · 157 citations
  3. Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment AnalysisKai Zhang, Kun Zhang, Mengdi Zhang, Hongke Zhao et al.ACL Findings 2022 · 76 citations
  4. Hierarchy-aware Label Semantics Matching Network for Hierarchical Text ClassificationHaibin Chen, Qianli Ma, Zhenxi Lin, Jiangyue YanACL 2021

Related papers

  1. Concept-Based Label Embedding via Dynamic Routing for Hierarchical Text ClassificationXuepeng Wang, Li Zhao, Bing Liu, Tao Chen et al.ACL 2021
  2. Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text ClassificationSimon Chi Lok U, Jie He, Víctor Gutiérrez-Basulto, Jeff Z. PanEMNLP Findings 2023 · 18 citations
  3. HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text ClassificationZihan Wang, Peiyi Wang, Tianyu Liu, Binghuai Lin et al.EMNLP 2022 · 42 citations
  4. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
  5. Knowledge-Aware Bayesian Deep Topic ModelDongsheng Wang, Yishi Xu, Miaoge Li, Zhibin Duan et al.NeurIPS 2022 · 19 citations
Dusk over the sea between two cliffs drawn in fine vertical lines