Hedging as Reward Augmentation in Probabilistic Graphical Models
Debarun Bhattacharjya, Radu Marinescu
Abstract
Most people associate the term ‘hedging’ exclusively with financial applications, particularly the use of financial derivatives. We argue that hedging is an activity that human and machine agents should engage in more broadly, even when the agent’s value is not necessarily in monetary units. In this paper, we propose a decision-theoretic view of hedging based on augmenting a probabilistic graphical model – specifically a Bayesian network or an influence diagram – with a reward. Hedging is therefore posed as a particular kind of graph manipulation, and can be viewed as analogous to control/intervention and information gathering related analysis. Effective hedging occurs when a risk-averse agent finds opportunity to balance uncertain rewards in their current situation. We illustrate the concepts with examples and counter-examples, and conduct experiments to demonstrate the properties and applicability of the proposed computational tools that enable agents to proactively identify potential hedging opportunities in real-world situations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext be176b62-c94c-4e3f-a099-895bab83c379Related papers
- Dynamic Knowledge Injection for AIXI AgentsSamuel Yang-Zhao, Kee Siong Ng, Marcus HutterAAAI 2024
- Rehearsal Learning for Avoiding Undesired FutureTian Qin, Tian-Zuo Wang, Zhi-Hua ZhouNeurIPS 2023 · 8 citations
- Agent Incentives: A Causal PerspectiveTom Everitt, Ryan Carey, Eric D. Langlois, Pedro A. Ortega et al.AAAI 2021 · 66 citations
- A New Bounding Scheme for Influence DiagramsRadu Marinescu, Junkyu Lee, Rina DechterAAAI 2021 · 1 citation
- How About Kind of Generating Hedges using End-to-End Neural Models?Alafate Abulimiti, Chloé Clavel, Justine CassellACL 2023 · 2 citations
