Lune

EMNLP Findings2023

What Makes it Ok to Set a Fire? Iterative Self-distillation of Contexts and Rationales for Disambiguating Defeasible Social and Moral Situations

Kavel Rao, Liwei Jiang, Valentina Pyatkin, Yuling Gu, Niket Tandon, Nouha Dziri, Faeze Brahman, Yejin Choi

Abstract

Moral or ethical judgments rely heavily on the specific contexts in which they occur.Understanding varying shades of defeasible contextualizations (i.e., additional information that strengthens or attenuates the moral acceptability of an action) is critical to accurately represent the subtlety and intricacy of grounded human moral judgment in real-life scenarios.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

8 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing cites Language Models are Few-Shot Learners
  • Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment cites Language Models are Few-Shot Learners
  • When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the Machiavelli Benchmark cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Language Models are Few-Shot Learners cites The Curious Case of Neural Text Degeneration
  • MythTriage: Scalable Detection of Opioid Use Disorder Myths on a Video-Sharing Platform cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers8

  1. Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in ConversationsRitam Dutt, Zhen Wu, Jiaxin Shi, Divyanshu Sheth et al.ACL 2024 · 2 citations
  2. Social Story Frames: Contextual Reasoning about Narrative Intent and ReceptionJoel Mire, Maria Antoniak, Steven R. Wilson, Zexin Ma et al.ACL 2026 · 2 citations
  3. Decoding the Rule Book: Extracting Hidden Moderation Criteria from Reddit CommunitiesYoungwoo Kim, Himanshu Beniwal, Steven L. Johnson, Thomas HartvigsenEMNLP 2025
  4. Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving TestingHan Jiang, Xiaoyuan Yi, Zhihua Wei, Ziang Xiao et al.ICML 2025
  5. MythTriage: Scalable Detection of Opioid Use Disorder Myths on a Video-Sharing PlatformHayoung Jung, Shravika Mittal, Ananya Aatreya, Navreet Kaur et al.EMNLP 2025

Builds on20

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  3. The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
  4. Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the Machiavelli BenchmarkAlexander Pan, Jun Shern Chan, Andy Zou, Nathaniel Li et al.ICML 2023 · 200 citations
  5. When to Make Exceptions: Exploring Language Models as Accounts of Human Moral JudgmentZhijing Jin, Sydney Levine, Fernando Gonzalez Adauto, Ojasv Kamal et al.NeurIPS 2022 · 146 citations

Related papers

  1. ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral SituationsValentina Pyatkin, Jena D. Hwang, Vivek Srikumar, Ximing Lu et al.ACL 2023 · 12 citations
  2. Contextual Conditional ReasoningGiovanni Casini, Thomas Andreas Meyer, Ivan VarzinczakAAAI 2021 · 9 citations
  3. Towards Explaining Subjective Ground of Individuals on Social MediaYounghun Lee, Dan GoldwasserEMNLP Findings 2022
  4. Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language ModelsZhining Liu, Tianyi Wang, Xiao Lin, Penghao Ouyang et al.ACL Findings 2026
  5. Machine Behavior in Relational Moral Dilemmas: Moral Rightness, Predicted Human Behavior, and Model DecisionsJiseon Kim, Jea Kwon, Luiz Felipe Vecchietti, Wenchao Dong et al.ACL Findings 2026
Dusk over the sea between two cliffs drawn in fine vertical lines