MUDY: Multi-Granular Dynamic Candidate Contextualization for Unsupervised Keyphrase Extraction
Hyeongu Kang, Susik Yoon
Abstract
Keyphrase extraction aims to automatically identify concise phrases that effectively represent the content of a document. While recent methods leveraging pre-trained language models (PLMs) have significantly improved the extraction of keyphrases with strong global semantic relevance, they often fall short in capturing the local contextual importance of keyphrases tied to specific subtopics dispersed in a document. In this paper, we propose a novel context-centric framework, MUDY, that effectively captures multi-granular contextual salience of candidate keyphrases. MUDY employs two complementary components: (1) a prompt-based scoring that estimates the generation likelihood of each candidate keyphrase, augmented with candidate-aware weighting to better reflect its local contextual importance, and (2) a self-attention-based scoring that utilizes multi-granular attention patterns from PLMs to assess candidate significance at both the document-wide and segment-specific levels. Evaluations on four real-world datasets demonstrate that MUDY outperforms state-of-the-art baselines in top-k accuracy at various cutoff thresholds. In-depth quantitative and qualitative analyses further highlight the efficacy of context-centric keyphrase extraction with multi-granular saliency. For reproducibility, the source code of MUDY is available at https://github.com/HgKang1/MUDY.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- One Size Does Not Fit All: Generating and Evaluating Variable Number of KeyphrasesXingdi Yuan, Tong Wang, Rui Meng, Khushboo Thaker et al.ACL 2020 · 76 citations
- Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global ContextXinnian Liang, Shuangzhi Wu, Mu Li, Zhoujun LiEMNLP 2021 · 49 citations
- PromptRank: Unsupervised Keyphrase Extraction Using PromptAobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li et al.ACL 2023 · 31 citations
- SAMRank: Unsupervised Keyphrase Extraction using Self-Attention Map in BERT and GPT-2Byungha Kang, Youhyun ShinEMNLP 2023 · 11 citations
Related papers
- AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross AttentionsHaoran Ding, Xiao LuoEMNLP 2021 · 46 citations
- Importance Estimation from Multiple Perspectives for Keyphrase ExtractionMingyang Song, Liping Jing, Lin XiaoEMNLP 2021 · 17 citations
- HyperRank: Hyperbolic Ranking Model for Unsupervised Keyphrase ExtractionMingyang Song, Huafeng Liu, Liping JingEMNLP 2023 · 5 citations
- Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence ModelsDi Wu, Wasi Uddin Ahmad, Kai-Wei ChangEMNLP 2023 · 6 citations
- UCPhrase: Unsupervised Context-aware Quality Phrase TaggingXiaotao Gu, Zihan Wang, Zhenyu Bi, Yu Meng et al.KDD 2021 · 17 citations
