Open Domain Event Text Generation
Zihao Fu, Lidong Bing, Wai Lam
Abstract
Text generation tasks aim at generating human-readable text from different kinds of data. Normally, the generated text only contains the information included in the data and its application is thus restricted to some limited scenarios. In this paper, we extend the task to an open domain event text generation scenario with an entity chain as its skeleton. Specifically, given an entity chain containing several related event entities, the model should retrieve from a trustworthy repository (e.g. Wikipedia) the detailed information of these entities and generate a description text based on the retrieved sentences. We build a new dataset called WikiEvent 1 that provides 34K pairs of entity chain and its corresponding description sentences. To solve the problem, we propose a wiki augmented generator framework that contains an encoder, a retriever, and a decoder. The encoder encodes the entity chain into a hidden space while the decoder decodes from the hidden space and generates description text. The retriever retrieves relevant text from a trustworthy repository which provides more information for generation. To alleviate the overfitting problem, we propose a novel random drop component that randomly deletes words from the retrieved sentences making our model more robust for handling long input sentences. We apply the proposed model on the WikiEvent dataset and compare it with a few baselines. The experimental results show that our carefully-designed architecture does help generate better event text, and extensive analysis further uncovers the characteristics of the proposed task.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 06fba8f5-d275-4676-a3cf-3bdb3035ada9Cited by top-tier papers3
- A Theoretical Analysis of the Repetition Problem in Text GenerationZihao Fu, Wai Lam, Anthony Man-Cho So, Bei ShiAAAI 2021 · 114 citations
- ENT-DESC: Entity Description Generation by Exploring Knowledge GraphLiying Cheng, Dekun Wu, Lidong Bing, Yan Zhang et al.EMNLP 2020 · 22 citations
- Partially-Aligned Data-to-Text Generation with Distant SupervisionZihao Fu, Bei Shi, Wai Lam, Lidong Bing et al.EMNLP 2020 · 19 citations
Related papers
- A Unified Encoder-Decoder Framework with Entity MemoryZhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng JiangEMNLP 2022 · 9 citations
- Hindsight: Posterior-guided training of retrievers for improved open-ended generationAshwin Paranjape, Omar Khattab, Christopher Potts, Matei Zaharia et al.ICLR 2022 · 48 citations
- DESCGEN: A Distantly Supervised Datasetfor Generating Entity DescriptionsWeijia Shi, Mandar Joshi, Luke ZettlemoyerACL 2021
- EventRAG: Enhancing LLM Generation with Event Knowledge GraphsZairun Yang, Yilin Wang, Zhengyan Shi, Yuan Yao et al.ACL 2025 · 6 citations
- Generating Biographies on Wikipedia: The Impact of Gender Bias on the Retrieval-Based Generation of Women BiographiesAngela Fan, Claire GardentACL 2022
