Lune

ACL Findings2023

Data Augmentation for Low-Resource Keyphrase Generation

Krishna Garg, Jishnu Ray Chowdhury, Cornelia Caragea

Abstract

Keyphrase generation is the task of summarizing the contents of any given article into a few salient phrases (or keyphrases). Existing works for the task mostly rely on large-scale annotated datasets, which are not easy to acquire. Very few works address the problem of keyphrase generation in low-resource settings, but they still rely on a lot of additional unlabeled data for pretraining and on automatic methods for pseudo-annotations. In this paper, we present data augmentation strategies specifically to address keyphrase generation in purely resource-constrained domains. We design techniques that use the full text of the articles to improve both present and absent keyphrase generation. We test our approach comprehensively on three datasets and show that the data augmentation strategies consistently improve the state-of-the-art performance. We release our source code at https://github. com/kgarg8/kpgen-lowres-data-aug.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 3 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers3

  1. Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence ModelsDi Wu, Wasi Uddin Ahmad, Kai-Wei ChangEMNLP 2023 · 6 citations
  2. Multi-Task Knowledge Distillation with Embedding Constraints for Scholarly Keyphrase Boundary ClassificationSeo Park, Cornelia CarageaEMNLP 2023 · 1 citation
  3. EUROPA: A Legal Multilingual Keyphrase Generation DatasetOlivier Salaün, Frédéric Piedboeuf, Guillaume Le Berre, David Alfonso-Hermelo et al.ACL 2024

Builds on11

  1. Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
  2. One Size Does Not Fit All: Generating and Evaluating Variable Number of KeyphrasesXingdi Yuan, Tong Wang, Rui Meng, Khushboo Thaker et al.ACL 2020 · 76 citations
  3. Exclusive Hierarchical Decoding for Deep Keyphrase GenerationWang Chen, Hou Pong Chan, Piji Li, Irwin KingACL 2020 · 62 citations
  4. Unsupervised Deep Keyphrase GenerationXianjie Shen, Yinghan Wang, Rui Meng, Jingbo ShangAAAI 2022 · 19 citations
  5. UniKeyphrase: A Unified Extraction and Generation Framework for Keyphrase PredictionHuanqin Wu, Wei Liu, Lei Li, Dan Nie et al.ACL Findings 2021 · 18 citations

Related papers

  1. Representation Learning for Resource-Constrained Keyphrase GenerationDi Wu, Wasi Uddin Ahmad, Sunipa Dev, Kai-Wei ChangEMNLP Findings 2022 · 9 citations
  2. Fast and Constrained Absent Keyphrase Generation by Prompt-Based LearningHuanqin Wu, Baijiaxin Ma, Wei Liu, Tao Chen et al.AAAI 2022 · 31 citations
  3. Keyphrase Generation Beyond the Boundaries of Title and AbstractKrishna Garg, Jishnu Ray Chowdhury, Cornelia CarageaEMNLP Findings 2022 · 5 citations
  4. Structure-Augmented Keyphrase GenerationJihyuk Kim, Myeongho Jeong, Seungtaek Choi, Seung-won HwangEMNLP 2021
  5. SimCKP: Simple Contrastive Learning of Keyphrase RepresentationsMinseok Choi, Chaeheon Gwak, Seho Kim, Si Hyeong Kim et al.EMNLP Findings 2023 · 3 citations
Dusk over the sea between two cliffs drawn in fine vertical lines