Lune

ACL Findings2023

Improving Embedding-based Unsupervised Keyphrase Extraction by Incorporating Structural Information

Mingyang Song, Huafeng Liu, Yi Feng, Liping Jing

Abstract

Keyphrase extraction aims to extract a set of keyphrases with the central idea of the document. In a structured document, there are certain locations (e.g., the title or the first sentence) where a keyphrase is most likely to appear. However, when extracting keyphrases from the document, most existing embedding-based unsupervised keyphrase extraction models ignore the indicative role of the highlights in certain locations, leading to wrong keyphrases extraction. In this paper, we propose a new Highlight-Guided Unsupervised Keyphrase Extraction model (HGUKE) to address the above issue. Specifically, HGUKE first models the phrasedocument relevance via the highlights of the documents. Next, HGUKE calculates the crossphrase relevance between all candidate phrases. Finally, HGUKE aggregates the above two relevance as the importance score of each candidate to rank and extract keyphrases. The experimental results on three benchmarks demonstrate that HGUKE outperforms the state-of-the-art unsupervised keyphrase extraction baselines.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 3 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers3

  1. Mitigating Over-Generation for Unsupervised Keyphrase Extraction with Heterogeneous Centrality DetectionMingyang Song, Pengyu Xu, Yi Feng, Huafeng Liu et al.EMNLP 2023 · 5 citations
  2. HyperRank: Hyperbolic Ranking Model for Unsupervised Keyphrase ExtractionMingyang Song, Huafeng Liu, Liping JingEMNLP 2023 · 5 citations
  3. ERU-KG: Efficient Reference-aligned Unsupervised Keyphrase GenerationLam Thanh Do, Aaditya Bodke, Pritom Saha Akash, Kevin Chen-Chuan ChangACL 2025

Builds on4

  1. MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase ExtractionLinhan Zhang, Qian Chen, Wen Wang, Chong Deng et al.ACL Findings 2022 · 63 citations
  2. Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global ContextXinnian Liang, Shuangzhi Wu, Mu Li, Zhoujun LiEMNLP 2021 · 49 citations
  3. AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross AttentionsHaoran Ding, Xiao LuoEMNLP 2021 · 46 citations
  4. Importance Estimation from Multiple Perspectives for Keyphrase ExtractionMingyang Song, Liping Jing, Lin XiaoEMNLP 2021 · 17 citations

Related papers

  1. Unsupervised Deep Keyphrase GenerationXianjie Shen, Yinghan Wang, Rui Meng, Jingbo ShangAAAI 2022 · 19 citations
  2. Unsupervised Keyphrase Extraction by Learning Neural Keyphrase Set FunctionMingyang Song, Haiyun Jiang, Lemao Liu, Shuming Shi et al.ACL Findings 2023 · 6 citations
  3. HTKG: Deep Keyphrase Generation with Neural Hierarchical Topic GuidanceYuxiang Zhang, Tao Jiang, Tianyu Yang, Xiaoli Li et al.SIGIR 2022 · 14 citations
  4. SAMRank: Unsupervised Keyphrase Extraction using Self-Attention Map in BERT and GPT-2Byungha Kang, Youhyun ShinEMNLP 2023 · 11 citations
  5. PromptRank: Unsupervised Keyphrase Extraction Using PromptAobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li et al.ACL 2023 · 31 citations
Dusk over the sea between two cliffs drawn in fine vertical lines