RLSLM: A Hybrid Framework Combining Reinforcement Learning and a Rule-based Social Locomotion Model for Socially-aware Navigation
Yitian Kou, Yihe Gu, Chen Zhou, Dandan Zhu, Shu-Guang Kuai
Abstract
Navigating human-populated environments without causing discomfort is a critical capability for socially-aware agents. While rule-based approaches offer interpretability through predefined psychological principles, they often lack generalizability and flexibility. Conversely, data-driven methods can learn complex behaviors from large-scale datasets, but are typically inefficient, opaque, and difficult to align with human intuitions. To bridge this gap, we propose RLSLM, a hybrid Reinforcement Learning framework that integrates a rule-based Social Locomotion Model, grounded in empirical behavioral experiments, into its reward function. The social locomotion model generates an orientation-sensitive social comfort field that quantifies human comfort across space, enabling socially aligned navigation policies with minimal training. RLSLM then jointly optimizes mechanical energy and social comfort, allowing agents to avoid intrusions into personal or group space. A human-agent interaction experiment using an immersive VR-based setup demonstrates that RLSLM outperforms state-of-the-art rule-based models in user experience. Ablation and sensitivity analyses further show the model's significantly improved interpretability over conventional data-driven methods. This work presents a scalable, human-centered methodology that effectively integrates cognitive science and machine learning for real-world social navigation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on1
Related papers
- LocoVR: Multiuser Indoor Locomotion Dataset in Virtual RealityKojiro Takeyama, Yimeng Liu, Misha SraICLR 2025
- The Impact of Navigation on Proxemics in an Immersive Virtual Environment with Conversational AgentsRose Connolly, Lauren E. Buck, Victor B. Zordan, Rachel McDonnellIEEE VR 2025 · 12 citations
- Exploiting Proximity-Aware Tasks for Embodied Social NavigationEnrico Cancelli, Tommaso Campari, Luciano Serafini, Angel X. Chang et al.ICCV 2023 · 16 citations
- SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied NavigationZiyi Chen, Yingnan Guo, Zedong Chu, Minghua Luo et al.CVPR 2026 · 19 citations
- GREIL-Crowds: Crowd Simulation with Deep Reinforcement Learning and ExamplesPanayiotis Charalambous, Julien Pettré, Vassilis Vassiliades, Yiorgos Chrysanthou et al.SIGGRAPH 2023 · 48 citations
