Fact-based Text Editing
Hayate Iso, Chao Qiao, Hang Li
Abstract
We propose a novel text editing task, referred to as fact-based text editing, in which the goal is to revise a given document to better describe the facts in a knowledge base (e.g., several triples). The task is important in practice because reflecting the truth is a common requirement in text editing. First, we propose a method for automatically generating a dataset for research on fact-based text editing, where each instance consists of a draft text, a revised text, and several facts represented in triples. We apply the method into two public tableto-text datasets, obtaining two new datasets consisting of 233k and 37k instances, respectively. Next, we propose a new neural network architecture for fact-based text editing, called FACTEDITOR, which edits a draft text by referring to given facts using a buffer, a stream, and a memory. A straightforward approach to address the problem would be to employ an encoder-decoder model. Our experimental results on the two datasets show that FACTE-DITOR outperforms the encoder-decoder approach in terms of fidelity and fluency. The results also show that FACTEDITOR conducts inference faster than the encoder-decoder approach. * The work was done when Hayate Iso was a research intern at ByteDance AI Lab.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e372902a-a631-4cb3-8fea-6fd440e5cd8dCited by top-tier papers8
- RARR: Researching and Revising What Language Models Say, Using Language ModelsLuyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen et al.ACL 2023 · 90 citations
- Learning Structural Edits via Incremental Tree TransformationsZiyu Yao, Frank F. Xu, Pengcheng Yin, Huan Sun et al.ICLR 2021 · 32 citations
- Updated Headline Generation: Creating Updated Summaries for Evolving News StoriesSheena Panthaplackel, Adrian Benton, Mark DredzeACL 2022 · 15 citations
- KID-Review: Knowledge-Guided Scientific Review Generation with Oracle Pre-trainingWeizhe Yuan, Pengfei LiuAAAI 2022 · 14 citations
- Converge to the Truth: Factual Error Correction via Iterative Constrained EditingJiangjie Chen, Rui Xu, Wenxuan Zeng, Changzhi Sun et al.AAAI 2023 · 13 citations
Related papers
- Editing Language Model-Based Knowledge Graph EmbeddingsSiyuan Cheng, Ningyu Zhang, Bozhong Tian, Xi Chen et al.AAAI 2024 · 40 citations
- Editing Factual Knowledge in Language ModelsNicola De Cao, Wilker Aziz, Ivan TitovEMNLP 2021 · 20 citations
- Scaling Knowledge Editing in LLMs to 100, 000 Facts with Neural KV DatabaseWeizhi Fei, Hao Shi, Jing Xu, Jingchen Peng et al.ICLR 2026 · 2 citations
- Retrieval-Augmented Multilingual Knowledge EditingWeixuan Wang, Barry Haddow, Alexandra BirchACL 2024
- FAME: Towards Factual Multi-Task Model EditingZeng Li, Yingyu Shan, Zeming Liu, Jiashu Yao et al.EMNLP 2024 · 1 citation
