EMNLP Findings2021
Few-Shot Table-to-Text Generation with Prototype Memory
Yixuan Su, Zaiqiao Meng, Simon Baker, Nigel Collier
Abstract
Neural table-to-text generation models have achieved remarkable progress on an array of tasks. However, due to the data-hungry nature of neural models, their performances strongly rely on large-scale training examples, limiting their applicability in real-world applications. To address this, we propose a new framework: Prototype-to-Generate (P2G), for table-to-text generation under the few-shot scenario. The proposed framework utilizes the retrieved prototypes, which are jointly selected by an IR system and a novel prototype selector to help the model bridging the structural gap between tables and texts. Experimental results on three benchmark datasets with three state-of-the-art models demonstrate that the proposed framework significantly improves the model performance across various evaluation metrics.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
8 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Dense Passage Retrieval for Open-Domain Question Answering cites BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
- Dense Passage Retrieval for Open-Domain Question Answering cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks cites Dense Passage Retrieval for Open-Domain Question Answering
- AutoDDG: Automated Dataset Description Generation using Large Language Models cites KGPT: Knowledge-Grounded Pre-Training for Data-to-Text Generation
- BioReader: a Retrieval-Enhanced Text-to-Text Transformer for Biomedical Literature cites Dense Passage Retrieval for Open-Domain Question Answering
- BioReader: a Retrieval-Enhanced Text-to-Text Transformer for Biomedical Literature cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- A Contrastive Framework for Neural Text Generation cites Neural Text Generation With Unlikelihood Training
- A Contrastive Framework for Neural Text Generation cites Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System
- Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System cites A Contrastive Framework for Neural Text Generation
- Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System cites BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks cites BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
Cited by top-tier papers8
- A Contrastive Framework for Neural Text GenerationYixuan Su, Tian Lan, Yan Wang, Dani Yogatama et al.NeurIPS 2022 · 349 citations
- Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue SystemYixuan Su, Lei Shu, Elman Mansimov, Arshit Gupta et al.ACL 2022 · 218 citations
- BioReader: a Retrieval-Enhanced Text-to-Text Transformer for Biomedical LiteratureGiacomo Frisoni, Miki Mizutani, Gianluca Moro, Lorenzo ValgimigliEMNLP 2022 · 26 citations
- AutoDDG: Automated Dataset Description Generation using Large Language ModelsHaoxiang Zhang, Yurong Liu, Aécio S. R. Santos, Wei-Lun Hung et al.SIGMOD 2026 · 17 citations
- PAGED: A Benchmark for Procedural Graphs Extraction from DocumentsWeihong Du, Wenrui Liao, Hongru Liang, Wenqiang LeiACL 2024 · 4 citations
Builds on9
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Neural Text Generation With Unlikelihood TrainingSean Welleck, Ilia Kulikov, Stephen Roller, Emily Dinan et al.ICLR 2020 · 683 citations
- Dense Passage Retrieval for Open-Domain Question AnsweringVladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis et al.EMNLP 2020 · 142 citations
- KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationWenhu Chen, Yu Su, Xifeng Yan, William Yang WangEMNLP 2020 · 115 citations
Related papers
- Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few ShotsWenting Zhao, Ye Liu, Yao Wan, Philip S. YuEMNLP Findings 2021 · 12 citations
- Towards Table-to-Text Generation with Numerical ReasoningLya Hulliyyatus Suadaa, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu Okumura et al.ACL 2021
- TAROT: Task-Adaptive Refinement of LLM-prior Graphs for Few-shot Tabular LearningRuxue Shi, Yili Wang, Mengnan Du, Hangting Ye et al.KDD 2026
- Search and Learn: Improving Semantic Coverage for Data-to-Text GenerationShailza Jolly, Zi Xuan Zhang, Andreas Dengel, Lili MouAAAI 2022 · 15 citations
- Structure-Aware Pre-Training for Table-to-Text GenerationXinyu Xing, Xiaojun WanACL Findings 2021 · 20 citations
