Value of Information: A Framework for Human-Agent Communication
Yijiang River Dong, Tiancheng Hu, Zheng Hui, Caiqi Zhang, Ivan Vulic, Andreea Bobu, Nigel Collier
摘要
Large Language Model (LLM) agents deployed for real-world tasks face a fundamental dilemma: user requests are underspecified, yet agents must decide whether to act on incomplete information or interrupt users for clarification. Existing approaches either rely on brittle confidence thresholds that require taskspecific tuning, or fail to account for the varying stakes of different decisions. We introduce a decision-theoretic framework that resolves this trade-off through the Value of Information (VoI), enabling agents to dynamically weigh the expected utility gain from asking questions against the cognitive cost imposed on users. Our inference-time method requires no hyperparameter tuning and adapts seamlessly across contexts-from casual games to medical diagnosis. Experiments across four diverse domains (20 Questions, medical diagnosis, flight booking, and e-commerce) show that VoI consistently matches or exceeds the best manually-tuned baselines, achieving up to 1.36 utility points higher in high-cost settings. This work provides a parameterfree framework for adaptive agent communication that explicitly balances task risk, query ambiguity, and user effort. Our code will be available at https://github.com/ dong-river/VOI_communication .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- WebShop: Towards Scalable Real-World Web Interaction with Grounded Language AgentsShunyu Yao, Howard Chen, John Yang, Karthik NarasimhanNeurIPS 2022 · 被引用 1,477 次
- Inferring Rewards from Language in ContextJessy Lin, Daniel Fried, Dan Klein, Anca D. DraganACL 2022 · 被引用 71 次
- Semantic Volume: Quantifying and Detecting Both External and Internal Uncertainty in LLMsXiaomin Li, Zhou Yu, Ziji Zhang, Yingying Zhuang 等AAAI 2026 · 被引用 11 次
- Shoot First, Ask Questions Later? Building Rational Agents that Explore and Act Like PeopleGabriel Grand, Valerio Pepe, Joshua B. Tenenbaum, Jacob AndreasICLR 2026 · 被引用 7 次
- RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation FrameworkYifan Wang, Vera DembergEMNLP 2024 · 被引用 2 次
相关 Paper
- Uncertainty-Aware Clarification in LLM Agents with Information GainMengyi DENG, Zhiwei Li, Xin Li, Tingyu ZHU 等ICML 2026 · 被引用 1 次
- Active Task Disambiguation with LLMsKasia Kobalczyk, Nicolás Astorga, Tennison Liu, Mihaela van der SchaarICLR 2025
- DeLLMa: Decision Making Under Uncertainty with Large Language ModelsOllie Liu, Deqing Fu, Dani Yogatama, Willie NeiswangerICLR 2025
- Feedback-Aware MCTS for Goal-Oriented Information SeekingHarshita Chopra, Chirag ShahNeurIPS 2025 · 被引用 2 次
- Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in LLMsZhiyuan Hu, Chumin Liu, Xidong Feng, Yilun Zhao 等NeurIPS 2024 · 被引用 43 次
