Lune

EMNLP Findings2021

SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation

Hong Chen, Hiroya Takamura, Hideki Nakayama

Abstract

Generating texts in scientific papers requires not only capturing the content contained within the given input but also frequently acquiring the external information called context. We push forward the scientific text generation by proposing a new task, namely context-aware text generation in the scientific domain, aiming at exploiting the contributions of context in generated texts. To this end, we present a novel challenging largescale Scientific Paper Dataset for ConteXt-Aware Text Generation (SciXGen), consisting of well-annotated 205,304 papers with full references to widely-used objects (e.g., tables, figures, algorithms) in a paper. We comprehensively benchmark, using state-of-the-arts, the efficacy of our newly constructed SciX-Gen dataset in generating description and paragraph. Our dataset and benchmarks will be made publicly available to hopefully facilitate the scientific text generation research.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 4 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers4

  1. DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive LearningXun Guo, Yongxin He, Shan Zhang, Ting Zhang et al.NeurIPS 2024 · 100 citations
  2. MAGE: Machine-generated Text Detection in the WildYafu Li, Qintong Li, Leyang Cui, Wei Bi et al.ACL 2024 · 44 citations
  3. ExeGPT: Constraint-Aware Resource Scheduling for LLM InferenceHyungjun Oh, Kihong Kim, Jaemin Kim, Sungkyun Kim et al.ASPLOS 2024 · 41 citations
  4. AI Argues Differently: Distinct Argumentative and Linguistic Patterns of LLMs in Persuasive ContextsEsra Dönmez, Maximilian Maurer, Gabriella Lapesa, Agnieszka FalenskaEMNLP 2025 · 1 citation

Builds on4

  1. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
  2. S2ORC: The Semantic Scholar Open Research CorpusKyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney et al.ACL 2020 · 424 citations
  3. ToTTo: A Controlled Table-To-Text Generation DatasetAnkur P. Parikh, Xuezhi Wang, Sebastian Gehrmann, Manaal Faruqui et al.EMNLP 2020 · 69 citations
  4. SPECTER: Document-level Representation Learning using Citation-informed TransformersArman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey et al.ACL 2020 · 20 citations

Related papers

  1. SciTables : A Dataset and Evaluation Framework for Complex Table-to-Text GenerationMehrnoush Alizade, Tengrui Kong, Suman Kalyan MaityVLDB 2026
  2. CiteBench: A Benchmark for Scientific Citation Text GenerationMartin Funkquist, Ilia Kuznetsov, Yufang Hou, Iryna GurevychEMNLP 2023 · 2 citations
  3. SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback RefinementIshani Mondal, Zongxia Li, Yufang Hou, Anandhavelu Natarajan et al.EMNLP Findings 2024 · 4 citations
  4. CitationSum: Citation-aware Graph Contrastive Learning for Scientific Paper SummarizationZheheng Luo, Qianqian Xie, Sophia AnaniadouWWW 2023 · 19 citations
  5. Citance-Contextualized Summarization of Scientific PapersShahbaz Syed, Ahmad Dawar Hakimi, Khalid Al Khatib, Martin PotthastEMNLP Findings 2023 · 8 citations
Dusk over the sea between two cliffs drawn in fine vertical lines