EMNLP Findings2020
TLDR: Extreme Summarization of Scientific Documents
Isabel Cachola, Kyle Lo, Arman Cohan, Daniel S. Weld
Abstract
We introduce TLDR generation, a new form of extreme summarization, for scientific papers.TLDR generation involves high source compression and requires expert background knowledge and understanding of complex domain-specific language.To facilitate study on this task, we introduce SCITLDR, a new multi-target dataset of 5.4K TLDRs over 3.2K papers.SCITLDR contains both author-written and expert-derived TLDRs, where the latter are collected using a novel annotation protocol that produces high-quality summaries while minimizing annotation burden.We propose CATTS, a simple yet effective learning strategy for generating TLDRs that exploits titles as an auxiliary training signal.CATTS improves upon strong baselines under both automated metrics and human evaluations.Data and code are publicly available at https://github.com/allenai/scitldr. Dataset constructionOverview We introduce SCITLDR, a new multitarget dataset of 5,411 TLDRs over 3,229 scientific papers in the computer science domain.3 The training set contains 1,992 papers, each with a single gold TLDR.The dev and test sets contain 619 and 618 papers each, with 1,452 and 1,967 TLDRs, respectively.This is unlike the majority of existing 3 See Appendix Table 9 for full venue breakdown.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 46 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers46
- Automated Lay Language Summarization of Biomedical Scientific ReviewsYue Guo, Wei Qiu, Yizhong Wang, Trevor CohenAAAI 2021 · 100 citations
- Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and SymbolsAndrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok et al.CHI 2021 · 91 citations
- MS2: Multi-Document Summarization of Medical StudiesJay DeYoung, Iz Beltagy, Madeleine van Zuylen, Bailey Kuehl et al.EMNLP 2021 · 83 citations
- Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific LiteratureHyeonsu B. Kang, Joseph Chee Chang, Yongsung Kim, Aniket KitturUIST 2022 · 48 citations
- CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical ContextJoseph Chee Chang, Amy X. Zhang, Jonathan Bragg, Andrew Head et al.CHI 2023 · 44 citations
Builds on4
- PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, Peter J. LiuICML 2020 · 2,453 citations
- S2ORC: The Semantic Scholar Open Research CorpusKyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney et al.ACL 2020 · 424 citations
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingHangbo Bao, Li Dong, Furu Wei, Wenhui Wang et al.ICML 2020 · 423 citations
- Conditional Augmentation for Aspect Term Extraction via Masked Sequence-to-Sequence GenerationKun Li, Chengbo Chen, Xiaojun Quan, Qing Ling et al.ACL 2020 · 101 citations
Related papers
- CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited SupervisionYuning Mao, Ming Zhong, Jiawei HanEMNLP 2022 · 11 citations
- SciLitLLM: How to Adapt LLMs for Scientific Literature UnderstandingSihang Li, Jin Huang, Jiaxi Zhuang, Yaorui Shi et al.ICLR 2025 · 1 citation
- AutoMalDesc: Large-Scale Script Analysis for Cyber Threat ResearchAlexandru-Mihai Apostu, Andrei Preda, Alexandra Daniela Damir, Diana Bolocan et al.AAAI 2026
- What Are You Token About? Differentiable Perturbed Top-k Token Selection for Scientific Document SummarizationLuca Ragazzi, Paolo Italiani, Gianluca Moro, Mattia PanniACL Findings 2024 · 3 citations
- Cross-lingual Science Journalism: Select, Simplify and Rewrite Summaries for Non-expert ReadersMehwish Fatima, Michael StrubeACL 2023 · 2 citations
