EMNLP Findings2022
Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations in a Label-Abundant Setup
Yordan Yordanov, Vid Kocijan, Thomas Lukasiewicz, Oana-Maria Camburu
Abstract
Training a model to provide natural language explanations (NLEs) for its predictions usually requires the acquisition of task-specific NLEs, which is time-and resource-consuming. A potential solution is the few-shot out-of-domain transfer of NLEs from a parent task with many NLEs to a child task. In this work, we examine the setup in which the child task has few NLEs but abundant labels. We establish four few-shot transfer learning methods that cover the possible fine-tuning combinations of the labels and NLEs for the parent and child tasks. We transfer explainability from a large natural language inference dataset (e-SNLI) separately to two child tasks: (1) hard cases of pronoun resolution, where we introduce the small-e-WinoGrande dataset of NLEs on top of the WinoGrande dataset, and (2) commonsense validation (ComVE). Our results demonstrate that the parent task helps with NLE generation and we establish the best methods for this setup.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Knowledge-Grounded Self-Rationalization via Extractive and Natural Language Explanations cites NILE : Natural Language Inference with Faithful Natural Language Explanations
- e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks cites NILE : Natural Language Inference with Faithful Natural Language Explanations
Cited by top-tier papers1
Builds on5
- WinoGrande: An Adversarial Winograd Schema Challenge at ScaleKeisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, Yejin ChoiAAAI 2020 · 3,037 citations
- Few-shot Natural Language Generation for Task-Oriented DialogBaolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li et al.EMNLP Findings 2020 · 164 citations
- e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language TasksMaxime Kayser, Oana-Maria Camburu, Leonard Salewski, Cornelius Emde et al.ICCV 2021 · 115 citations
- Knowledge-Grounded Self-Rationalization via Extractive and Natural Language ExplanationsBodhisattwa Prasad Majumder, Oana Camburu, Thomas Lukasiewicz, Julian J. McAuleyICML 2022 · 40 citations
- NILE : Natural Language Inference with Faithful Natural Language ExplanationsSawan Kumar, Partha P. TalukdarACL 2020 · 15 citations
Related papers
- Ecologically Valid Explanations for Label Variation in NLINan-Jiang Jiang, Chenhao Tan, Marie-Catherine de MarneffeEMNLP Findings 2023
- Improving Unsupervised Commonsense Reasoning Using Knowledge-Enabled Natural Language InferenceCanming Huang, Weinan He, Yongmei LiuEMNLP Findings 2021 · 8 citations
- Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI ModelsJoe Stacey, Pasquale Minervini, Haim Dubossarsky, Marek ReiEMNLP 2022 · 5 citations
- FLamE: Few-shot Learning from Natural Language ExplanationsYangqiaoyu Zhou, Yiming Zhang, Chenhao TanACL 2023 · 8 citations
- LIREx: Augmenting Language Inference with Relevant ExplanationsXinyan Zhao, V. G. Vinod VydiswaranAAAI 2021 · 41 citations
