Lune

EMNLP Findings2023

Interpreting Indirect Answers to Yes-No Questions in Multiple Languages

Zijie Wang, Md Mosharaf Hossain, Shivam Mathur, Terry Cruz Melo, Kadir Bulut Özler, Keun Hee Park, Jacob Quintero, MohammadHossein Rezaei, Shreya Nupur Shakya, Md Nayem Uddin, Eduardo Blanco

Abstract

Yes-no questions expect a yes or no for an answer, but people often skip polar keywords.

Instead, they answer with long explanations that must be interpreted. In this paper, we focus on this challenging problem and release new benchmarks in eight languages. We present a distant supervision approach to collect training data. We also demonstrate that direct answers (i.e., with polar keywords) are useful to train models to interpret indirect answers (i.e., without polar keywords). Experimental results demonstrate that monolingual fine-tuning is beneficial if training data can be obtained via distant supervision for the language of interest (5 languages). Additionally, we show that cross-lingual fine-tuning is always beneficial (8 languages).

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. Identifying and Answering Questions with False Assumptions: An Interpretable ApproachZijie Wang, Eduardo BlancoEMNLP 2025

Builds on19

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. TruthfulQA: Measuring How Models Mimic Human FalsehoodsStephanie Lin, Jacob Hilton, Owain EvansACL 2022 · 3,228 citations
  3. Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
  4. Lessons Learned from the Chameleon TestbedKate Keahey, Jason Anderson, Zhuo Zhen, Pierre Riteau et al.USENIX ATC 2020 · 398 citations
  5. Reframing Instructional Prompts to GPTk's LanguageDaniel Khashabi, Chitta Baral, Yejin Choi, Hannaneh HajishirziACL Findings 2022 · 126 citations

Related papers

  1. Interpreting Answers to Yes-No Questions in User-Generated ContentShivam Mathur, Keun Hee Park, Dhivya Chinnappa, Saketh Kotamraju et al.EMNLP Findings 2023 · 1 citation
  2. The RELX Dataset and Matching the Multilingual Blanks for Cross-lingual Relation ClassificationAbdullatif Köksal, Arzucan ÖzgürEMNLP Findings 2020 · 20 citations
  3. Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Cross-Lingual Transfer in Sense-Aware TasksRoksana Goworek, Haim DubossarskyEMNLP 2025 · 2 citations
  4. PAXQA: Generating Cross-lingual Question Answering Examples at Training ScaleBryan Li, Chris Callison-BurchEMNLP Findings 2023 · 2 citations
  5. "I'd rather just go to bed": Understanding Indirect AnswersAnnie Louis, Dan Roth, Filip RadlinskiEMNLP 2020
Dusk over the sea between two cliffs drawn in fine vertical lines