PromptRank: Unsupervised Keyphrase Extraction Using Prompt
Aobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li, Yong Qin, Ruiqi Sun, Xiaoyan Bai
Abstract
The keyphrase extraction task refers to the automatic selection of phrases from a given document to summarize its core content. Stateof-the-art (SOTA) performance has recently been achieved by embedding-based algorithms, which rank candidates according to how similar their embeddings are to document embeddings. However, such solutions either struggle with the document and candidate length discrepancies or fail to fully utilize the pretrained language model (PLM) without further fine-tuning. To this end, in this paper, we propose a simple yet effective unsupervised approach, PromptRank, based on the PLM with an encoder-decoder architecture. Specifically, PromptRank feeds the document into the encoder and calculates the probability of generating the candidate with a designed prompt by the decoder. We extensively evaluate the proposed PromptRank on six widely used benchmarks. PromptRank outperforms the SOTA approach MDERank, improving the F 1 score relatively by 34.18%, 24.87%, and 17.57% for 5, 10, and 15 returned results, respectively. This demonstrates the great potential of using prompt for unsupervised keyphrase extraction. We release our code at this url. × Document Encoder Decoder This book mainly talks about [Candidate] Book: "[Document]" Candidate Position Information c 1 c 2 c n ... ...
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- What Makes a Good Natural Language Prompt?Do Xuan Long, Duy Dinh, Ngoc-Hai Nguyen, Kenji Kawaguchi et al.ACL 2025 · 13 citations
- Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence ModelsDi Wu, Wasi Uddin Ahmad, Kai-Wei ChangEMNLP 2023 · 6 citations
- One2Set + Large Language Model: Best Partners for Keyphrase GenerationLiangying Shao, Liang Zhang, Minlong Peng, Guoqi Ma et al.EMNLP 2024 · 2 citations
- IRIS: Interpretable Retrieval-Augmented Classification for Long Interspersed Document SequencesFengnan Li, Elliot D. Hill, Jiang Shu, Jiaxin Gao et al.ACL 2025
- MUDY: Multi-Granular Dynamic Candidate Contextualization for Unsupervised Keyphrase ExtractionHyeongu Kang, Susik YoonSIGIR 2026
Builds on6
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation ExtractionXiang Chen, Ningyu Zhang, Xin Xie, Shumin Deng et al.WWW 2022 · 488 citations
- AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross AttentionsHaoran Ding, Xiao LuoEMNLP 2021 · 46 citations
- Prefix-Tuning: Optimizing Continuous Prompts for GenerationXiang Lisa Li, Percy LiangACL 2021
Related papers
- SAMRank: Unsupervised Keyphrase Extraction using Self-Attention Map in BERT and GPT-2Byungha Kang, Youhyun ShinEMNLP 2023 · 11 citations
- HyperRank: Hyperbolic Ranking Model for Unsupervised Keyphrase ExtractionMingyang Song, Huafeng Liu, Liping JingEMNLP 2023 · 5 citations
- Unsupervised Deep Keyphrase GenerationXianjie Shen, Yinghan Wang, Rui Meng, Jingbo ShangAAAI 2022 · 19 citations
- Unsupervised Open-domain Keyphrase GenerationLam Do, Pritom Saha Akash, Kevin Chen-Chuan ChangACL 2023 · 2 citations
- Fast and Constrained Absent Keyphrase Generation by Prompt-Based LearningHuanqin Wu, Baijiaxin Ma, Wei Liu, Tao Chen et al.AAAI 2022 · 31 citations
