"We Demand Justice!": Towards Social Context Grounding of Political Texts
Rajkumar Pujari, Chengfei Wu, Dan Goldwasser
Abstract
Political discourse on social media often contains similar language with opposing intended meanings. For example, the phrase thoughts and prayers, is used to express sympathy for mass shooting victims, as well as satirically criticize the lack of legislative action on gun control. Understanding such discourse fully by reading only the text is difficult. However, knowledge of the social context information makes it easier. We characterize the social context required to fully understand such ambiguous discourse, by grounding the text in real-world entities, actions, and attitudes. We propose two datasets that require an understanding of social context and benchmark them using large pre-trained language models and several novel structured models. We show that structured models, explicitly modeling social context, outperform larger models on both tasks, but still lag significantly behind human performance. Finally, we perform an extensive analysis, to obtain further insights into the language understanding challenges posed by our social grounding tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- A Closer Look at Multidimensional Online Political IncivilitySagi Pendzel, Nir Lotan, Alon Zoizner, Einat MinkovEMNLP 2024 · 2 citations
- ConceptCarve: Dynamic Realization of EvidenceEylon Caplan, Dan GoldwasserACL 2025
- Splits! Flexible Sociocultural Linguistic Investigation at ScaleEylon Caplan, Tania Chakraborty, Dan GoldwasserACL 2026
Builds on12
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Climbing towards NLU: On Meaning, Form, and Understanding in the Age of DataEmily M. Bender, Alexander KollerACL 2020 · 914 citations
- Experience Grounds LanguageYonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas et al.EMNLP 2020 · 74 citations
- Tackling Fake News Detection by Continually Improving Social Context Representations using Graph Neural NetworksNikhil Mehta, Maria Leonor Pacheco, Dan GoldwasserACL 2022 · 46 citations
- A fine-grained comparison of pragmatic language understanding in humans and language modelsJennifer Hu, Sammy Floyd, Olessia Jouravlev, Evelina Fedorenko et al.ACL 2023 · 45 citations
Related papers
- EMODIS: A Benchmark for Context-Dependent Emoji Disambiguation in Large Language ModelsJiacheng Huang, Ning Yu, Xiaoyin YiAAAI 2026
- Which side are you on? Insider-Outsider classification in conspiracy-theoretic social mediaPavan Holur, Tianyi Wang, Shadi Shahsavari, Timothy R. Tangherlini et al.ACL 2022
- Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political QuestionsClara Lachenmaier, Judith Sieker, Sina ZarrießACL 2025
- ePiC: Employing Proverbs in Context as a Benchmark for Abstract Language UnderstandingSayan Ghosh, Shashank SrivastavaACL 2022
- GunStance: Stance Detection for Gun Control and Gun RegulationNikesh Gyawali, Iustin Sirbu, Tiberiu Sosea, Sarthak Khanal et al.ACL 2024 · 1 citation
