EMNLP Findings2023
Interpreting Indirect Answers to Yes-No Questions in Multiple Languages
Zijie Wang, Md Mosharaf Hossain, Shivam Mathur, Terry Cruz Melo, Kadir Bulut Özler, Keun Hee Park, Jacob Quintero, MohammadHossein Rezaei, Shreya Nupur Shakya, Md Nayem Uddin, Eduardo Blanco
Abstract
Yes-no questions expect a yes or no for an answer, but people often skip polar keywords.
Instead, they answer with long explanations that must be interpreted. In this paper, we focus on this challenging problem and release new benchmarks in eight languages. We present a distant supervision approach to collect training data. We also demonstrate that direct answers (i.e., with polar keywords) are useful to train models to interpret indirect answers (i.e., without polar keywords). Experimental results demonstrate that monolingual fine-tuning is beneficial if training data can be obtained via distant supervision for the language of interest (5 languages). Additionally, we show that cross-lingual fine-tuning is always beneficial (8 languages).
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on19
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- TruthfulQA: Measuring How Models Mimic Human FalsehoodsStephanie Lin, Jacob Hilton, Owain EvansACL 2022 · 3,228 citations
- Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
- Lessons Learned from the Chameleon TestbedKate Keahey, Jason Anderson, Zhuo Zhen, Pierre Riteau et al.USENIX ATC 2020 · 398 citations
- Reframing Instructional Prompts to GPTk's LanguageDaniel Khashabi, Chitta Baral, Yejin Choi, Hannaneh HajishirziACL Findings 2022 · 126 citations
Related papers
- Interpreting Answers to Yes-No Questions in User-Generated ContentShivam Mathur, Keun Hee Park, Dhivya Chinnappa, Saketh Kotamraju et al.EMNLP Findings 2023 · 1 citation
- The RELX Dataset and Matching the Multilingual Blanks for Cross-lingual Relation ClassificationAbdullatif Köksal, Arzucan ÖzgürEMNLP Findings 2020 · 20 citations
- Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Cross-Lingual Transfer in Sense-Aware TasksRoksana Goworek, Haim DubossarskyEMNLP 2025 · 2 citations
- PAXQA: Generating Cross-lingual Question Answering Examples at Training ScaleBryan Li, Chris Callison-BurchEMNLP Findings 2023 · 2 citations
- "I'd rather just go to bed": Understanding Indirect AnswersAnnie Louis, Dan Roth, Filip RadlinskiEMNLP 2020
