NAREOR: The Narrative Reordering Problem
Varun Gangal, Steven Y. Feng, Malihe Alikhani, Teruko Mitamura, Eduard H. Hovy
Abstract
Many implicit inferences exist in text depending on how it is structured that can critically impact the text's interpretation and meaning. One such structural aspect present in text with chronology is the order of its presentation. For narratives or stories, this is known as the narrative order. Reordering a narrative can impact the temporal, causal, event-based, and other inferences readers draw from it, which in turn can have strong effects both on its interpretation and interestingness. In this paper, we propose and investigate the task of Narrative Reordering (NAREOR) which involves rewriting a given story in a different narrative order while preserving its plot. We present a dataset, NAREORC, with human rewritings of stories within ROCStories in non-linear orders, and conduct a detailed analysis of it. Further, we propose novel task-specific training methods with suitable evaluation metrics. We perform experiments on NAREORC using state-of-the-art models such as BART and T5 and conduct extensive automatic and human evaluations. We demonstrate that although our models can perform decently, NAREOR is a challenging task with potential for further exploration. We also investigate two applications of NAREOR: generation of more interesting variations of stories and serving as adversarial sets for temporal/event-related tasks, besides discussing other prospective ones, such as for pedagogical setups related to language skills like essay writing and applications to medicine involving clinical narratives.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 502caeec-3805-45f0-b746-be51eab2b5b5Cited by top-tier papers3
- Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation ModelsSteven Y. Feng, Kevin Lu, Zhuofu Tao, Malihe Alikhani et al.AAAI 2022 · 15 citations
- TC-DWA: Text Clustering with Dual Word-Level AugmentationBo Cheng, Ximing Li, Yi ChangAAAI 2023 · 6 citations
- StoryWars: A Dataset and Instruction Tuning Baselines for Collaborative Story Understanding and GenerationYulun Du, Lydia B. ChiltonACL 2023 · 3 citations
Builds on4
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense ReasoningYe Liu, Yao Wan, Lifang He, Hao Peng et al.AAAI 2021 · 220 citations
Related papers
- Conditional Generation of Temporally-ordered Event SequencesShih-Ting Lin, Nathanael Chambers, Greg DurrettACL 2021
- Is Everything in Order? A Simple Way to Order SentencesSomnath Basu Roy Chowdhury, Faeze Brahman, Snigdha ChaturvediEMNLP 2021 · 2 citations
- PlotMachines: Outline-Conditioned Generation with Dynamic Plot State TrackingHannah Rashkin, Asli Celikyilmaz, Yejin Choi, Jianfeng GaoEMNLP 2020 · 100 citations
- Sketch and Customize: A Counterfactual Story GeneratorChangying Hao, Liang Pang, Yanyan Lan, Yan Wang et al.AAAI 2021 · 17 citations
- Draft and Edit: Automatic Storytelling Through Multi-Pass Hierarchical Conditional Variational AutoencoderMeng-Hsuan Yu, Juntao Li, Danyang Liu, Bo Tang et al.AAAI 2020 · 26 citations
