The time scale of redundancy between prosody and linguistic context
Tamar I. Regev, Chiebuka Ohams, Shaylee Xie, Lukas Wolf, Evelina Fedorenko, Alex Warstadt, Ethan Wilcox, Tiago Pimentel
摘要
In spoken communication, information is transmitted not only via words, but also through a rich array of non-verbal signals, including prosody--the non-segmental auditory features of speech. Do these different communication channels carry distinct information? Prior work has shown that the information carried by prosodic features is substantially redundant with that carried by the surrounding words. Here, we systematically examine the time scale of this relationship, studying how it varies with the length of past and future contexts. We find that a word's prosodic features require an extended past context (3-8 words across different features) to be reliably predicted. Given that long-scale contextual information decays in memory, prosody may facilitate communication by adding information that is locally unique. We also find that a word's prosodic features show some redundancy with future words, but only with a short scale of 1-2 words, consistent with reports of incremental short-term planning in language production. Thus, prosody may facilitate communication by helping listeners predict upcoming material. In tandem, our results highlight potentially distinct roles that prosody plays in facilitating integration of words into past contexts and in helping predict upcoming words.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-AccentEthan Wilcox, Cui Ding, Giovanni Acampa, Tiago Pimentel 等ACL 2025 · 被引用 3 次
- What Do Prosody and Text Convey? Characterizing How Meaningful Information is Distributed Across Multiple ChannelsAditya Yadavalli, Tiago Pimentel, Tamar I. Regev, Ethan Gotlieb Wilcox 等ACL 2026 · 被引用 1 次
- Modeling Bottom-up Information Quality during Language ProcessingCui Ding, Yanning Yin, Lena Ann Jäger, Ethan WilcoxEMNLP 2025
它引用的顶会 Paper5
- Context Limitations Make Neural Language Models More Human-LikeTatsuki Kuribayashi, Yohei Oseki, Ana Brassard, Kentaro InuiEMNLP 2022 · 被引用 28 次
- Quantifying the redundancy between prosody and textLukas Wolf, Tiago Pimentel, Evelina Fedorenko, Ryan Cotterell 等EMNLP 2023 · 被引用 5 次
- Revisiting the Uniform Information Density HypothesisClara Meister, Tiago Pimentel, Patrick Haller, Lena A. Jäger 等EMNLP 2021 · 被引用 4 次
- Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-AccentEthan Wilcox, Cui Ding, Giovanni Acampa, Tiago Pimentel 等ACL 2025 · 被引用 3 次
- A surprisal-duration trade-off across and within the world's languagesTiago Pimentel, Clara Meister, Elizabeth Salesky, Simone Teufel 等EMNLP 2021 · 被引用 2 次
相关 Paper
- The neural dynamics of word recognition and integrationJon Gauthier, Roger LevyEMNLP 2023
- Aligning Backchannel and Dialogue Context Representations via Contrastive LLM Fine-TuningLivia Qian, Gabriel SkantzeACL 2026
- Speech Token Prediction via Compressed-to-fine Language Modeling for Speech GenerationWenrui Liu, Qian Chen, Wen Wang, Guanrou Yang 等ACM MM 2025
- Language Reconstruction with Brain Predictive Coding from fMRI DataCongchi Yin, Ziyi Ye, Piji LiACL 2026 · 被引用 5 次
- Towards A Scanpath-Conditioned Surprisal Theory: Modeling Reader Information StatesMichael Mooney, Edmond S. L. HoACL 2026
