Lune

EMNLP Findings2023

Conditional Natural Language Inference

Youngwoo Kim, Razieh Rahimi, James Allan

Abstract

To properly explain sentence pairs that provide contradictory (different) information for different conditions, we introduce the task of conditional natural language inference (Cond-NLI) and focus on automatically extracting contradictory aspects and their conditions from a sentence pair. Cond-NLI can help to provide a full spectrum of information, such as when there are multiple answers to a question each addressing a specific condition, or reviews with different opinions for different conditions. We show that widely-used feature-attribution explanation models are not suitable for finding conditions, especially when sentences are long and are written independently. We propose a simple yet effective model for the NLI task that can successfully extract conditions while not requiring token-level annotations. Our model enhances the interpretability while maintaining comparable accuracy. To evaluate Cond-NLI, we present a token-level annotated dataset BioClaim which contains potentially contradictory claims from the biomedical articles. Experiments show that our model outperforms the full cross-encoder and other baselines in extracting conditions. It also performs on-par with GPT-3 which has an order of magnitude more parameters and trained on a huge amount of data. 1

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Decoding the Rule Book: Extracting Hidden Moderation Criteria from Reddit Communities cites Discovering Biases in Information Retrieval Models Using Relevance Thesaurus as Global Explanation
  • Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
  • The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanations cites ERASER: A Benchmark to Evaluate Rationalized NLP Models
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. Discovering Biases in Information Retrieval Models Using Relevance Thesaurus as Global ExplanationYoungwoo Kim, Razieh Rahimi, James AllanEMNLP 2024 · 3 citations
  2. Decoding the Rule Book: Extracting Hidden Moderation Criteria from Reddit CommunitiesYoungwoo Kim, Himanshu Beniwal, Steven L. Johnson, Thomas HartvigsenEMNLP 2025

Builds on9

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  3. AmbigQA: Answering Ambiguous Open-domain QuestionsSewon Min, Julian Michael, Hannaneh Hajishirzi, Luke ZettlemoyerEMNLP 2020 · 162 citations
  4. The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance ExplanationsPeter Hase, Harry Xie, Mohit BansalNeurIPS 2021 · 121 citations
  5. ERASER: A Benchmark to Evaluate Rationalized NLP ModelsJay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, Eric P. Lehman et al.ACL 2020 · 36 citations

Related papers

  1. NLI4CT: Multi-Evidence Natural Language Inference for Clinical Trial ReportsMaël Jullien, Marco Valentino, Hannah Frost, Paul O'Regan et al.EMNLP 2023 · 6 citations
  2. BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial ExamplesMohaddeseh Bastan, Mihai Surdeanu, Niranjan BalasubramanianEMNLP Findings 2022 · 9 citations
  3. C-STS: Conditional Semantic Textual SimilarityAmeet Deshpande, Carlos E. Jimenez, Howard Chen, Vishvak Murahari et al.EMNLP 2023 · 9 citations
  4. Explaining Relationships Between Scientific DocumentsKelvin Luu, Xinyi Wu, Rik Koncel-Kedziorski, Kyle Lo et al.ACL 2021
  5. Validity Assessment of Legal Will Statements as Natural Language InferenceAlice Saebom Kwak, Jacob O. Israelsen, Clayton T. Morrison, Derek E. Bambauer et al.EMNLP Findings 2022 · 5 citations
Dusk over the sea between two cliffs drawn in fine vertical lines