NarraGuide: an LLM-based Narrative Mobile Robot for Remote Place Exploration
Yaxin Hu, Arissa J. Sato, Jingxin Du, Chenming Ye, Anjun Zhu, Pragathi Praveena, Bilge Mutlu
Abstract
Robotic telepresence enables users to navigate and experience remote environments. However, effective navigation and situational awareness depend on users’ prior knowledge of the environment, limiting the usefulness of these systems for exploring unfamiliar places. We explore how integrating location-aware LLM-based narrative capabilities into a mobile robot can support remote exploration. We developed a prototype system, called NarraGuide, that provides narrative guidance for users to explore and learn about a remote place through a dialogue-based interface. We deployed our prototype in a geology museum, where remote participants (n = 20) used the robot to tour the museum. Our findings reveal how users perceived the robot’s role, engaged in dialogue in the tour, and expressed preferences for bystander encountering. Our work demonstrates the potential of LLM-enabled robotic capabilities to deliver location-aware narrative guidance and enrich the experience of exploring remote environments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 71e3ef61-b86b-45b0-822e-867de086b910Cited by top-tier papers1
Ask how each one uses itBuilds on10
- VirtuWander: Enhancing Multi-modal Interaction for Virtual Tour Guidance through Large Language ModelsZhan Wang, Linping Yuan, Liangwei Wang, Bingchuan Jiang et al.CHI 2024 · 74 citations
- PathFinder: Designing a Map-less Navigation System for Blind People in Unfamiliar BuildingsMasaki Kuribayashi, Tatsuya Ishihara, Daisuke Sato, Jayakorn Vongkulbhisal et al.CHI 2023 · 44 citations
- Polite or Direct? Conversation Design of a Smart Display for Older Adults Based on Politeness TheoryYaxin Hu, Yuxiao Qu, Adam Maus, Bilge MutluCHI 2022 · 43 citations
- VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive RobotsAkhil Padmanabha, Jessie Yuan, Janavi Gupta, Zulekha Karachiwalla et al.UIST 2024 · 40 citations
- "I am both here and there" Parallel Control of Multiple Robotic Avatars by Disabled Workers in a CaféGiulia Barbareschi, Midori Kawaguchi, Hiroaki Kato, Masato Nagahiro et al.CHI 2023 · 31 citations
Related papers
- TeleAware Robot: Designing Awareness-augmented Telepresence Robot for Remote Collaborative LocomotionRuyi Li, Yaxin Zhu, Min Liu, Yihang Zeng et al.UbiComp 2024 · 7 citations
- Guiding Multiple Remote Users in Physical Tasks with Language-driven Robotic TelepresenceRuyi Li, Jingfei Guo, Xinyi Zhang, Xuji Zhang et al.UbiComp 2025 · 1 citation
- Role-Aware Virtual Agents for Navigational Interaction guided by a Multimodal Large Language ModelMinyoung Kim, Changyang Li, Cuong Nguyen, Lap-Fai YuSIGGRAPH 2026
- Oak Story: Improving Learner Outcomes with LLM-Mediated Interactive NarrativesAlan Y. Cheng, Carolyn Q. Zou, Anthony Xie, Matthew Hsu et al.UIST 2025 · 2 citations
- Designing Immersive, Narrative-Based Interfaces to Guide Outdoor LearningAlan Y. Cheng, Jacob Ritchie, Niki Agrawal, Elizabeth Childs et al.CHI 2023 · 12 citations
