EMNLP Findings2023
Conditional Natural Language Inference
Abstract
To properly explain sentence pairs that provide contradictory (different) information for different conditions, we introduce the task of conditional natural language inference (Cond-NLI) and focus on automatically extracting contradictory aspects and their conditions from a sentence pair. Cond-NLI can help to provide a full spectrum of information, such as when there are multiple answers to a question each addressing a specific condition, or reviews with different opinions for different conditions. We show that widely-used feature-attribution explanation models are not suitable for finding conditions, especially when sentences are long and are written independently. We propose a simple yet effective model for the NLI task that can successfully extract conditions while not requiring token-level annotations. Our model enhances the interpretability while maintaining comparable accuracy. To evaluate Cond-NLI, we present a token-level annotated dataset BioClaim which contains potentially contradictory claims from the biomedical articles. Experiments show that our model outperforms the full cross-encoder and other baselines in extracting conditions. It also performs on-par with GPT-3 which has an order of magnitude more parameters and trained on a huge amount of data. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Decoding the Rule Book: Extracting Hidden Moderation Criteria from Reddit Communities cites Discovering Biases in Information Retrieval Models Using Relevance Thesaurus as Global Explanation
- Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
- The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanations cites ERASER: A Benchmark to Evaluate Rationalized NLP Models
Cited by top-tier papers2
- Discovering Biases in Information Retrieval Models Using Relevance Thesaurus as Global ExplanationYoungwoo Kim, Razieh Rahimi, James AllanEMNLP 2024 · 3 citations
- Decoding the Rule Book: Extracting Hidden Moderation Criteria from Reddit CommunitiesYoungwoo Kim, Himanshu Beniwal, Steven L. Johnson, Thomas HartvigsenEMNLP 2025
Builds on9
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- AmbigQA: Answering Ambiguous Open-domain QuestionsSewon Min, Julian Michael, Hannaneh Hajishirzi, Luke ZettlemoyerEMNLP 2020 · 162 citations
- The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance ExplanationsPeter Hase, Harry Xie, Mohit BansalNeurIPS 2021 · 121 citations
- ERASER: A Benchmark to Evaluate Rationalized NLP ModelsJay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, Eric P. Lehman et al.ACL 2020 · 36 citations
Related papers
- NLI4CT: Multi-Evidence Natural Language Inference for Clinical Trial ReportsMaël Jullien, Marco Valentino, Hannah Frost, Paul O'Regan et al.EMNLP 2023 · 6 citations
- BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial ExamplesMohaddeseh Bastan, Mihai Surdeanu, Niranjan BalasubramanianEMNLP Findings 2022 · 9 citations
- C-STS: Conditional Semantic Textual SimilarityAmeet Deshpande, Carlos E. Jimenez, Howard Chen, Vishvak Murahari et al.EMNLP 2023 · 9 citations
- Explaining Relationships Between Scientific DocumentsKelvin Luu, Xinyi Wu, Rik Koncel-Kedziorski, Kyle Lo et al.ACL 2021
- Validity Assessment of Legal Will Statements as Natural Language InferenceAlice Saebom Kwak, Jacob O. Israelsen, Clayton T. Morrison, Derek E. Bambauer et al.EMNLP Findings 2022 · 5 citations
