GenTouchVR: Generating a Touchable Virtual Reality Environment from a Single Image
Jaejun Park, Soyeon Nam, Jeongwoo Kim, Uison Ju, Seungmoon Choi
摘要
Creating interactive VR content typically requires extensive modeling effort, making scalable production difficult. We present an automated computational pipeline that converts a single image into an interactive 3D scene with plausible kinesthetic feedback. Our approach leverages a Large Language Model (LLM) to detect objects in the image and infer haptic properties from visual and textual cues. These extracted results are then utilized to synthesize 3D models and optimize haptic properties for perceptual distinguishability, while combining them into a complete interactive environment. A user study shows that the generated VR scenes provide compelling visuo-haptic experiences, highlighting the potential of our method for scalable multisensory world generation. To our knowledge, this is the first system to automatically produce VR scenes with force feedback from a single image, pointing toward a practical direction for lowering the barriers to creating haptically enriched VR content.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Scene2Hap: Generating Scene-Wide Haptics for VR from Scene Context with Multimodal LLMsArata Jingu, Easa AliAbbasi, Sara Safaee, Paul Strohmeier 等CHI 2026 · 被引用 4 次
- ProXeek: Seeking and Leveraging Real-World Objects and Environments as Haptic Proxies for Virtual Reality through Multimodal ReasoningHaichen Gao, Tianrui Hu, Zeshui Li, Kening ZhuSIGGRAPH 2026
- InteractVLM: 3D Interaction Reasoning from 2D Foundational ModelsSai Kumar Dwivedi, Dimitrije Antic, Shashank Tripathi, Omid Taheri 等CVPR 2025
- Exploring Large Language Model-Driven Agents for Environment-Aware Spatial Interactions and Conversations in Virtual Reality Role-Play ScenariosZiming Li, Huadong Zhang, Chao Peng, Roshan L. PeirisIEEE VR 2025 · 被引用 18 次
- Text2VRScene: Exploring the Framework of Automated Text-driven Generation System for VR ExperienceZhizhuo Yin, Yuyang Wang, Theodoros Papatheodorou, Pan HuiIEEE VR 2024 · 被引用 25 次
