Identifying Informational Sources in News Articles
Alexander Spangher, Nanyun Peng, Emilio Ferrara, Jonathan May
Abstract
News articles are driven by the informational sources journalists use in reporting. Modeling when, how and why sources get used together in stories can help us better understand the information we consume and even help journalists with the task of producing it. In this work, we take steps toward this goal by constructing the largest and widest-ranging annotated dataset, to date, of informational sources used in news writing. We first show that our dataset can be used to train high-performing models for information detection and source attribution. Then, we introduce a novel task, source prediction, to study the compositionality of sources in news articles – i.e. how they are chosen to complement each other. We show good modeling performance on this task, indicating that there is a pattern to the way different sources are used together in news storytelling. This insight opens the door for a focus on sources in narrative science (i.e. planning-based language generation) and computational journalism (i.e. a source-recommendation system to aid journalists writing stories). All data and model code can be found at https://github.com/alex2awesome/source-exploration.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0c0c7e6d-081c-4a49-af14-08ddcda8ff1aCited by top-tier papers2
- Do LLMs Plan Like Human Writers? Comparing Journalist Coverage of Press Releases with LLMsAlexander Spangher, Nanyun Peng, Sebastian Gehrmann, Mark DredzeEMNLP 2024 · 4 citations
- Tracking the Newsworthiness of Public DocumentsAlexander Spangher, Serdar Tumgoren, Ben Welsh, Nanyun Peng et al.ACL 2024
Builds on5
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie et al.NeurIPS 2020 · 3,159 citations
- Learning to Compress Prompts with Gist TokensJesse Mu, Xiang Li, Noah D. GoodmanNeurIPS 2023 · 488 citations
- Discourse as a Function of Event: Profiling Discourse Structure in News Articles around the Main EventPrafulla Kumar Choubey, Aaron Lee, Ruihong Huang, Lu WangACL 2020 · 54 citations
- DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational TransformerHaozhe Ji, Minlie HuangEMNLP 2021 · 17 citations
- Characterizing Search-Engine Traffic to Internet Research Agency Web PropertiesAlexander Spangher, Gireeja Ranade, Besmira Nushi, Adam Fourney et al.WWW 2020 · 8 citations
Related papers
- Generating Representative Headlines for News StoriesXiaotao Gu, Yuning Mao, Jiawei Han, Jialu Liu et al.WWW 2020 · 77 citations
- Visual News: Benchmark and Challenges in News Image CaptioningFuxiao Liu, Yinghan Wang, Tianlu Wang, Vicente OrdonezEMNLP 2021 · 67 citations
- We Can Detect Your Bias: Predicting the Political Ideology of News ArticlesRamy Baly, Giovanni Da San Martino, James R. Glass, Preslav NakovEMNLP 2020 · 6 citations
- MIND: A Large-scale Dataset for News RecommendationFangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu et al.ACL 2020 · 454 citations
- News Informatics: Engaging Individuals with Data-Rich News Content through Interactivity in Source, Medium, and MessageS. Shyam Sundar, Haiyan Jia, Saraswathi Bellur, Jeeyun Oh et al.CHI 2022 · 11 citations
