EMNLP Findings2023
Interpreting Answers to Yes-No Questions in User-Generated Content
Shivam Mathur, Keun Hee Park, Dhivya Chinnappa, Saketh Kotamraju, Eduardo Blanco
Abstract
Interpreting answers to yes-no questions in social media is difficult. Yes and no keywords are uncommon, and the few answers that include them are rarely to be interpreted what the keywords suggest. In this paper, we present a new corpus of 4,442 yes-no question-answer pairs from Twitter. We discuss linguistic characteristics of answers whose interpretation is yes or no, as well as answers whose interpretation is unknown. We show that large language models are far from solving this problem, even after fine-tuning and blending other corpora for the same problem but outside social media.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on4
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Do Models of Mental Health Based on Social Media Data Generalize?Keith Harrigian, Carlos Alejandro Aguirre, Mark DredzeEMNLP Findings 2020 · 45 citations
- Predicting the Focus of Negation: Model and Error AnalysisMd Mosharaf Hossain, Kathleen E. Hamilton, Alexis Palmer, Eduardo BlancoACL 2020 · 8 citations
- HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language GenerationZhoujun Cheng, Haoyu Dong, Zhiruo Wang, Ran Jia et al.ACL 2022
Related papers
- Interpreting Indirect Answers to Yes-No Questions in Multiple LanguagesZijie Wang, Md Mosharaf Hossain, Shivam Mathur, Terry Cruz Melo et al.EMNLP Findings 2023 · 1 citation
- "I'd rather just go to bed": Understanding Indirect AnswersAnnie Louis, Dan Roth, Filip RadlinskiEMNLP 2020
- Who is the richest club in the championship? Detecting and Rewriting Underspecified Questions Improve QA PerformanceYunchong Huang, Gianni Barlacchi, Sandro PezzelleACL Findings 2026
- This is not a Dataset: A Large Negation Benchmark to Challenge Large Language ModelsIker García-Ferrero, Begoña Altuna, Javier Álvez, Itziar Gonzalez-Dios et al.EMNLP 2023 · 8 citations
- Miko: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense DiscoveryFeihong Lu, Weiqi Wang, Yangyifei Luo, Ziqin Zhu et al.ACM MM 2024 · 11 citations
