Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization
Ayano Hiranaka, Ya-Chuan Hsu, Stefanos Nikolaidis, Erdem Biyik, Daniel Seita
摘要
AI assistants in human-AI collaboration often correct suboptimal human actions through behavioral feedback (e.g., alerts or steering-wheel nudges in assistive driving). Such interventions can mitigate immediate errors, but long-term improvement requires addressing the underlying misconceptions that cause repeated mistakes. We introduce SENSEI, a framework that infers user misconceptions from interaction behavior and provides targeted, minimal yet sufficient suggestions to correct them. Our approach departs from action-or trajectory-level interventions by operating over a structured knowledge representation to localize and correct the sources of erroneous behavior. Across three long-horizon tasks with diverse misconceptions and corresponding behaviors, SENSEI demonstrates zero-shot compositional generalization, disentangling multiple overlapping misconceptions despite training only on single-misconception cases. A user study further shows that our method identifies real human misconceptions and provides effective guidance that improves long-horizon task performance, successfully correcting 90% of student misconceptions. Code and project page are available at https://misoshiruseijin.github.io/SENSEI/.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Learning to Cooperate with Humans using Generative AgentsYancheng Liang, Daphne Chen, Abhishek Gupta, Simon S. Du 等NeurIPS 2024 · 被引用 32 次
- Learning to Influence Human Behavior with Offline Reinforcement LearningJoey Hong, Sergey Levine, Anca D. DraganNeurIPS 2023 · 被引用 30 次
- Hierarchical Expertise-Level Modeling for User Specific Robot-Behavior ExplanationsSarath Sreedharan, Tathagata Chakraborti, Christian Muise, Subbarao KambhampatiAAAI 2020 · 被引用 19 次
- Assistive Teaching of Motor Control Tasks to HumansMegha Srivastava, Erdem Biyik, Suvir Mirchandani, Noah D. Goodman 等NeurIPS 2022 · 被引用 12 次
相关 Paper
- State Your Intention to Steer Your Attention: An AI Assistant for Intentional Digital LivingJuheon Choi, Juyong Lee, Jian Kim, Chanyoung Kim 等CHI 2026 · 被引用 1 次
- GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI TasksSaelyne Yang, Jaesang Yu, Yi-Hao Peng, Kevin Qinghong Lin 等CVPR 2026 · 被引用 5 次
- Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action AnticipationQiaohui Chu, Haoyu Zhang, Meng Liu, Yisen Feng 等AAAI 2026 · 被引用 3 次
- Feedback-Guided Autonomous DrivingJimuyang Zhang, Zanming Huang, Arijit Ray, Eshed Ohn-BarCVPR 2024 · 被引用 15 次
- Persistent Assistant: Seamless Everyday AI Interactions via Intent Grounding and Multimodal FeedbackHyunsung Cho, Jacqui Fashimpaur, Naveen Sendhilnathan, Jonathan Browder 等CHI 2025 · 被引用 10 次
