Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization
Ayano Hiranaka, Ya-Chuan Hsu, Stefanos Nikolaidis, Erdem Biyik, Daniel Seita
Abstract
AI assistants in human-AI collaboration often correct suboptimal human actions through behavioral feedback (e.g., alerts or steering-wheel nudges in assistive driving). Such interventions can mitigate immediate errors, but long-term improvement requires addressing the underlying misconceptions that cause repeated mistakes. We introduce SENSEI, a framework that infers user misconceptions from interaction behavior and provides targeted, minimal yet sufficient suggestions to correct them. Our approach departs from action-or trajectory-level interventions by operating over a structured knowledge representation to localize and correct the sources of erroneous behavior. Across three long-horizon tasks with diverse misconceptions and corresponding behaviors, SENSEI demonstrates zero-shot compositional generalization, disentangling multiple overlapping misconceptions despite training only on single-misconception cases. A user study further shows that our method identifies real human misconceptions and provides effective guidance that improves long-horizon task performance, successfully correcting 90% of student misconceptions. Code and project page are available at https://misoshiruseijin.github.io/SENSEI/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7804679f-7030-41ad-8423-337fdc1da3caBuilds on4
- Learning to Cooperate with Humans using Generative AgentsYancheng Liang, Daphne Chen, Abhishek Gupta, Simon S. Du et al.NeurIPS 2024 · 32 citations
- Learning to Influence Human Behavior with Offline Reinforcement LearningJoey Hong, Sergey Levine, Anca D. DraganNeurIPS 2023 · 30 citations
- Hierarchical Expertise-Level Modeling for User Specific Robot-Behavior ExplanationsSarath Sreedharan, Tathagata Chakraborti, Christian Muise, Subbarao KambhampatiAAAI 2020 · 19 citations
- Assistive Teaching of Motor Control Tasks to HumansMegha Srivastava, Erdem Biyik, Suvir Mirchandani, Noah D. Goodman et al.NeurIPS 2022 · 12 citations
Related papers
- State Your Intention to Steer Your Attention: An AI Assistant for Intentional Digital LivingJuheon Choi, Juyong Lee, Jian Kim, Chanyoung Kim et al.CHI 2026 · 1 citation
- GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI TasksSaelyne Yang, Jaesang Yu, Yi-Hao Peng, Kevin Qinghong Lin et al.CVPR 2026 · 5 citations
- Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action AnticipationQiaohui Chu, Haoyu Zhang, Meng Liu, Yisen Feng et al.AAAI 2026 · 3 citations
- Feedback-Guided Autonomous DrivingJimuyang Zhang, Zanming Huang, Arijit Ray, Eshed Ohn-BarCVPR 2024 · 15 citations
- Persistent Assistant: Seamless Everyday AI Interactions via Intent Grounding and Multimodal FeedbackHyunsung Cho, Jacqui Fashimpaur, Naveen Sendhilnathan, Jonathan Browder et al.CHI 2025 · 10 citations
