Inverse Active Sensing: Modeling and Understanding Timely Decision-Making
Daniel Jarrett, Mihaela van der Schaar
Abstract
Evidence-based decision-making entails collecting (costly) observations about an underlying phenomenon of interest, and subsequently committing to an (informed) decision on the basis of accumulated evidence. In this setting, active sensing is the goal-oriented problem of efficiently selecting which acquisitions to make, and when and what decision to settle on. As its complement, inverse active sensing seeks to uncover an agent's preferences and strategy given their observable decision-making behavior. In this paper, we develop an expressive, unified framework for the general setting of evidence-based decision-making under endogenous, context-dependent time pressure---which requires negotiating (subjective) tradeoffs between accuracy, speediness, and cost of information. Using this language, we demonstrate how it enables modeling intuitive notions of surprise, suspense, and optimality in decision strategies (the forward problem). Finally, we illustrate how this formulation enables understanding decision-making behavior by quantifying preferences implicit in observed decision strategies (the inverse problem).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f31a14a5-afa5-4dde-84fd-49a62dcd09a5Cited by top-tier papers12
- Strictly Batch Imitation Learning by Energy-based Distribution MatchingDaniel Jarrett, Ioana Bica, Mihaela van der SchaarNeurIPS 2020 · 74 citations
- Invariant Causal Imitation Learning for Generalizable PoliciesIoana Bica, Daniel Jarrett, Mihaela van der SchaarNeurIPS 2021 · 46 citations
- Identifying Sepsis Subphenotypes via Time-Aware Multi-Modal Auto-EncoderChangchang Yin, Ruoqi Liu, Dongdong Zhang, Ping ZhangKDD 2020 · 46 citations
- Inverse Decision Modeling: Learning Interpretable Representations of BehaviorDaniel Jarrett, Alihan Hüyük, Mihaela van der SchaarICML 2021 · 30 citations
- Explaining by Imitating: Understanding Decisions by Interpretable Policy LearningAlihan Hüyük, Daniel Jarrett, Cem Tekin, Mihaela van der SchaarICLR 2021 · 22 citations
Builds on2
Related papers
- Uncertain Decisions Facilitate Better Preference LearningCassidy Laidlaw, Stuart RussellNeurIPS 2021 · 13 citations
- Probabilistic inverse optimal control for non-linear partially observable systems disentangles perceptual uncertainty and behavioral costsDominik Straub, Matthias Schultheis, Heinz Koeppl, Constantin A. RothkopfNeurIPS 2023 · 8 citations
- Bounded Risk-Sensitive Markov Games: Forward Policy Design and Inverse Reward Learning with Iterative Reasoning and Cumulative Prospect TheoryRan Tian, Liting Sun, Masayoshi TomizukaAAAI 2021 · 13 citations
- Inverse Optimal Control Adapted to the Noise Characteristics of the Human Sensorimotor SystemMatthias Schultheis, Dominik Straub, Constantin A. RothkopfNeurIPS 2021 · 25 citations
- Inverse Game Theory for Stackelberg Games: the Blessing of Bounded RationalityJibang Wu, Weiran Shen, Fei Fang, Haifeng XuNeurIPS 2022 · 27 citations
