Planning to Avoid Side Effects
Toryn Q. Klassen, Sheila A. McIlraith, Christian Muise, Jarvis Xu
Abstract
In sequential decision making, objective specifications are often underspecified or incomplete, neglecting to take into account potential (negative) side effects. In this paper we investigate how to avoid side effects in a classical planning setting. We formalize several versions of side-effectminimizing objectives for use in classical planning. We also study the notion of minimizing side effects in the context of a planning environment where multiple independent agents co-exist in a shared environment. We consider how side effects may compromise or prevent agents in the shared environment from achieving goals or executing plans that they would have otherwise been able to achieve, had the acting agent not executed their plan, and propose means to generate plans that minimize such negative side effects. Finally, we show how side-effect-minimizing plans can be computed via STRIPS planning with soft goals.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- Avoiding Side Effects By Considering Future TasksVictoria Krakovna, Laurent Orseau, Richard Ngo, Miljan Martic et al.NeurIPS 2020 · 54 citations
- Automated Synthesis of Social Laws in STRIPSRonen Nir, Alexander Shleyfman, Erez KarpasAAAI 2020 · 10 citations
- Querying to Find a Safe Policy under Uncertain Safety Constraints in Markov Decision ProcessesShun Zhang, Edmund H. Durfee, Satinder SinghAAAI 2020 · 6 citations
- Planning and Acting with Non-Deterministic Events: Navigating between Safe StatesLukás Chrpa, Jakub Gemrot, Martin PilátAAAI 2020 · 8 citations
- Goal Alignment: Re-analyzing Value Alignment Problems Using Human-Aware AIMalek Mechergui, Sarath SreedharanAAAI 2024 · 18 citations
