A decision-theoretic representation of assistive interfaces
Julien Gori, Aurélien Nioche, Christoph Albert Johns, Antti Oulasvirta
Abstract
Assistive interfaces, such as recommendation engines, adaptive systems, and intelligent assistants, span diverse methods and disciplines but lack a shared conceptual foundation. This paper models assistance as sequential decision-making under uncertainty between two agents: the user and the assistant. The formalism allows casting assistance as an optimization problem and offers a rich but principled vocabulary to understand the dynamics of assistance. Drawing on Partially Observable Stochastic Games (POSGs) and related models, we: (1) motivate multi-agent over single-agent formulations; (2) adapt POSGs to HCI and clarify their tractability through reductions;
(3) propose a two-agent sequential model that unambiguously defines concepts such as adaptation, augmentation, and delegation; (4) illustrate applicability through domain problems and examples; and (5) offer a supporting implementation via a library. These results warrant more attention on decision-theory as a principled yet actionable approach to assistive interfaces.
• Human-centered computing → HCI theory, concepts and models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bcf508c5-4c45-4995-9c29-1bbf40073aa8Builds on14
- Mastering Atari with Discrete World ModelsDanijar Hafner, Timothy P. Lillicrap, Mohammad Norouzi, Jimmy BaICLR 2021 · 1,170 citations
- Eureka: Human-Level Reward Design via Coding Large Language ModelsYecheng Jason Ma, William Liang, Guanzhi Wang, De-An Huang et al.ICLR 2024 · 582 citations
- PettingZoo: Gym for Multi-Agent Reinforcement LearningJ. K. Terry, Benjamin Black, Nathaniel Grammel, Mario Jayakumar et al.NeurIPS 2021 · 478 citations
- The Effects of Reward Misspecification: Mapping and Mitigating Misaligned ModelsAlexander Pan, Kush Bhatia, Jacob SteinhardtICLR 2022 · 293 citations
- SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic ConnectionsYifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi et al.UIST 2021 · 143 citations
Related papers
- Observation Interference in Partially Observable Assistance GamesScott Emmons, Caspar Oesterheld, Vincent Conitzer, Stuart RussellICML 2025
- (Computer) Vision in Action: Comparing Remote Sighted Assistance and a Multimodal Voice Agent in Inspection SequencesDamien Rudaz, Barbara Nino Carreras, Sara Merlino, Brian L. Due et al.CHI 2026 · 2 citations
- Zero-Shot Assistance in Sequential Decision ProblemsSebastiaan De Peuter, Samuel KaskiAAAI 2023 · 6 citations
- Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-MakingShuai Ma, Qiaoyi Chen, Xinru Wang, Chengbo Zheng et al.CHI 2025 · 113 citations
- Swarm UIs: Impact of Assistance on Users' Sense of AgencyOphelie Jobert, Amina Korghlou, Yelli Coulibaly, Thibaut Leone et al.CHI 2026 · 1 citation
