Smart Help: Strategic Opponent Modeling for Proactive and Adaptive Robot Assistance in Households
Zhihao Cao, Zidong Wang, Siwen Xie, Anji Liu, Lifeng Fan
Abstract
Despite the significant demand for assistive technology among vulnerable groups (e.g., the elderly, children, and the disabled) in daily tasks, research into advanced AIdriven assistive solutions that genuinely accommodate their diverse needs remains sparse. Traditional human-machine interaction tasks often require machines to simply help without nuanced consideration of human abilities and feelings, such as their opportunity for practice and learning, sense of self-improvement, and self-esteem. Addressing this gap, we define a pivotal and novel challenge Smart Help, which aims to provide proactive yet adaptive support to human agents with diverse disabilities and dynamic goals in various tasks and environments. To establish this challenge, we leverage AI2-THOR [32] to build a new interactive 3D realistic household environment for the Smart Help task. We introduce an innovative opponent modeling module that provides a nuanced understanding of the main agent's capabilities and goals, in order to optimize the assisting agent's helping policy. Rigorous experiments validate the efficacy of our model components and show the superiority of our holistic approach against established baselines. Our findings illustrate the potential of AI-imbued assistive robots in improving the well-being of vulnerable groups.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence On Mobile DevicesDezhi Kong, Zhengzhao Feng, Qiliang Liang, Hao Wang et al.CVPR 2026 · 6 citations
- MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied AgentsRuoxuan Zhang, Qiyun Zheng, Zhiyu Zhou, Ziqi Liao et al.CVPR 2026 · 6 citations
- EnergyAction: Unimanual to Bimanual Composition with Energy-Based ModelsMingchen Song, Xiang Deng, Jie Wei, Dongmei Jiang et al.CVPR 2026 · 1 citation
- Act2Intention: A Benchmark For Developing Active Mobile Agents Through Inferring User Intention from GUI ActionsXiaokai Yan, Jingtao Ding, Yong Li, Zhiwen YuUbiComp 2026
- Vision-Guided Action: Enhancing 3D Human Motion Prediction with Gaze-informed Affordance in 3D ScenesTing Yu, Yi Lin, Jun Yu, Zhenyu Lou et al.CVPR 2025
Builds on7
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Habitat: A Platform for Embodied AI ResearchManolis Savva, Jitendra Malik, Devi Parikh, Dhruv Batra et al.ICCV 2019 · 1,863 citations
- Habitat 2.0: Training Home Assistants to Rearrange their HabitatAndrew Szot, Alexander Clegg, Eric Undersander, Erik Wijmans et al.NeurIPS 2021 · 826 citations
- Watch-And-Help: A Challenge for Social Perception and Human-AI CollaborationXavier Puig, Tianmin Shu, Shuang Li, Zilin Wang et al.ICLR 2021 · 170 citations
- Model-Based Opponent ModelingXiaopeng Yu, Jiechuan Jiang, Wanpeng Zhang, Haobin Jiang et al.NeurIPS 2022 · 56 citations
Related papers
- Affordances from Human Videos as a Versatile Representation for RoboticsShikhar Bahl, Russell Mendonca, Lili Chen, Unnat Jain et al.CVPR 2023
- Promptable Behaviors: Personalizing Multi-Objective Rewards from Human PreferencesMinyoung Hwang, Luca Weihs, Chanwoo Park, Kimin Lee et al.CVPR 2024
- AI-to-Human Actuation: Boosting Unmodified AI's Robustness by Proactively Inducing Favorable Human Sensing ConditionsSungjae Cho, Yoonsu Kim, Jaewoong Jang, Inseok HwangUbiComp 2023 · 9 citations
- ManipulaTHOR: A Framework for Visual Object ManipulationKiana Ehsani, Winson Han, Alvaro Herrasti, Eli VanderBilt et al.CVPR 2021
- I Can Do It: Exploring Voice Assistants for Adults with Intellectual DisabilitiesMadhuka Nadeeshani, Jacqueline Johnstone, Kirsten Ellis, Swamy AnanthanarayanCHI 2026 · 1 citation
