Generating Query Focused Summaries from Query-Free Resources
Yumo Xu, Mirella Lapata
Abstract
The availability of large-scale datasets has driven the development of neural models that create generic summaries from single or multiple documents. In this work we consider query focused summarization (QFS), a task for which training data in the form of queries, documents, and summaries is not readily available. We propose to decompose QFS into (1) query modeling (i.e., finding supportive evidence within a set of documents for a query) and (2) conditional language modeling (i.e., summary generation). We introduce MARGE, a Masked ROUGE Regression framework for evidence estimation and ranking which relies on a unified representation for summaries and queries, so that summaries in generic data can be converted into proxy queries for learning a query model. Experiments across QFS benchmarks and query types show that our model achieves state-of-the-art performance despite learning from weak supervision. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f924c9fc-42ff-416c-9700-cfddc0c9e68bCited by top-tier papers10
- PDSum: Prototype-driven Continuous Summarization of Evolving Multi-document Sets StreamSusik Yoon, Hou Pong Chan, Jiawei HanWWW 2023 · 13 citations
- SINC: Self-Supervised In-Context Learning for Vision-Language TasksYi-Syuan Chen, Yun-Zhu Song, Cheng Yu Yeo, Bei Liu et al.ICCV 2023 · 8 citations
- SumREN: Summarizing Reported Speech about Events in NewsRevanth Gangi Reddy, Heba Elfardy, Hou Pong Chan, Kevin Small et al.AAAI 2023 · 7 citations
- Few-shot Query-Focused Summarization with Prefix-MergingRuifeng Yuan, Zili Wang, Ziqiang Cao, Wenjie LiEMNLP 2022 · 6 citations
- Text Summarization with Oracle ExpectationYumo Xu, Mirella LapataICLR 2023 · 3 citations
Builds on4
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingHangbo Bao, Li Dong, Furu Wei, Wenhui Wang et al.ICML 2020 · 423 citations
- Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze RewardLuyang Huang, Lingfei Wu, Lu WangACL 2020 · 152 citations
- Coarse-to-Fine Query Focused Multi-Document SummarizationYumo Xu, Mirella LapataEMNLP 2020 · 76 citations
Related papers
- Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement LearningSwaroop Nath, Pushpak Bhattacharyya, Harshad KhadilkarEMNLP 2023
- QuerySum: A Multi-Document Query-Focused Summarization Dataset Augmented with Similar Query ClustersYushan Liu, Zili Wang, Ruifeng YuanAAAI 2024 · 14 citations
- QTSumm: Query-Focused Summarization over Tabular DataYilun Zhao, Zhenting Qi, Linyong Nan, Boyu Mi et al.EMNLP 2023 · 4 citations
- Query-Focused Multimodal Summarization with Gate-Guided Mixture-of-ExpertsJiajun Han, Xuran Yang, Hui ZhangACM MM 2025 · 1 citation
- ASPECTNEWS: Aspect-Oriented Summarization of News DocumentsOjas Ahuja, Jiacheng Xu, Akshay Gupta, Kevin Horecka et al.ACL 2022
