iNews: A Multimodal Dataset for Modeling Personalized Affective Responses to News
Tiancheng Hu, Nigel Collier
Abstract
Understanding how individuals perceive and react to information is fundamental for advancing social and behavioral sciences and developing human-centered AI systems. Current approaches often lack the granular data needed to model these personalized responses, relying instead on aggregated labels that obscure the rich variability driven by individual differences. We introduce iNews, a novel large-scale dataset specifically designed to facilitate the modeling of personalized affective responses to news content. Our dataset comprises annotations from 291 demographically diverse UK participants across 2,899 multimodal Facebook news posts from major UK outlets, with an average of 5.18 annotators per sample. For each post, annotators provide multifaceted labels including valence, arousal, dominance, discrete emotions, content relevance judgments, sharing likelihood, and modality importance ratings. Crucially, we collect comprehensive annotator persona information covering demographics, personality, media trust, and consumption patterns, which explain 15.2% of annotation variance -substantially higher than existing NLP datasets. Incorporating this information yields a 7% accuracy gain in zero-shot prediction and remains beneficial even with 32-shot in-context learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- SimBench: Benchmarking the Ability of Large Language Models to Simulate Human BehaviorsTiancheng Hu, Joachim Baumann, Lorenzo Lupo, Nigel Collier et al.ICLR 2026 · 61 citations
- Persona-E²: A Human-Grounded Dataset for Personality-Shaped Emotional Responses to Textual EventsYuqin Yang, Haowu Zhou, Haoran Tu, Zhiwen Hui et al.ACL 2026
- Personalization up to a Point: Why Personalized Content Moderation Needs Boundaries, and How We Can Enforce ThemEmanuele Moscato, Tiancheng Hu, Matthias Orlikowski, Paul Röttger et al.EMNLP 2025
Builds on6
- Many-Shot In-Context LearningRishabh Agarwal, Avi Singh, Lei Zhang, Bernd Bohnet et al.NeurIPS 2024 · 271 citations
- Toward a Perspectivist Turn in Ground Truthing for Predictive ComputingFederico Cabitza, Andrea Campagner, Valerio BasileAAAI 2023 · 236 citations
- Dual Operating Modes of In-Context LearningZiqian Lin, Kangwook LeeICML 2024 · 50 citations
- Quantifying the Persona Effect in LLM SimulationsTiancheng Hu, Nigel CollierACL 2024 · 22 citations
- GoEmotions: A Dataset of Fine-Grained EmotionsDorottya Demszky, Dana Movshovitz-Attias, Jeongwoo Ko, Alan S. Cowen et al.ACL 2020 · 16 citations
Related papers
- Understanding News Consumers' Perceptions of Believability: A Study of Real and Fake NewsMostofa Najmus Sakib, Md Shoaib Ahmed, Francesca Spezzano, Anne HambyCSCW 2025 · 1 citation
- MIND: A Large-scale Dataset for News RecommendationFangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu et al.ACL 2020 · 454 citations
- Unifying Data Perspectivism and Personalization: An Application to Social NormsJoan Plepi, Béla Neuendorf, Lucie Flek, Charles WelchEMNLP 2022 · 4 citations
- FEALLM: Advancing Facial Emotion Analysis in Multimodal Large Language Models with Emotional Synergy and ReasoningZhuozhao Hu, Kaishen Yuan, Xin Liu, Zitong Yu et al.ACM MM 2025 · 3 citations
- Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?Rochelle Choenni, Ekaterina Shutova, Robert van RooijEMNLP 2021 · 13 citations
