Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation
Ziyang Xie, Zhizheng Liu, Zhenghao Peng, Wayne Wu, Bolei Zhou
2025年份
9顶会引用
摘要
Figure 1. Vid2Sim converts monocular video captured by a hand-held camera into realistic and interactive 3D simulation environments. It facilitates RL training of navigation agents in digital twins of urban scenes and provides realistic observations like RGB and depth to reduce the sim-to-real gap. The pink mobile robot in the image is a food delivery bot that avoids collisions with pedestrians and obstacles.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式，引用它的顶会 Paper 也一样。你提问，回答直接引用原文。
引用它的顶会 Paper9
- SimScale: Learning to Drive via Real-World Simulation at ScaleHaochen Tian, Tianyu Li, Haochen Liu, Jiazhi Yang 等CVPR 2026 · 被引用 40 次
- From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement LearningHonglin He, Yukai Ma, Brad Squicciarini, Wayne Wu 等ICLR 2026 · 被引用 19 次
- Model-Based Policy Adaptation for Closed-Loop End-to-end Autonomous DrivingHaohong Lin, Yunzhi Zhang, Wenhao Ding, Jiajun Wu 等NeurIPS 2025 · 被引用 11 次
- CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor NavigationXia Su, Ruiqi Chen, Benlin Liu, Jingwei Ma 等CVPR 2026 · 被引用 8 次
- UrbanVerse: Scaling Urban Simulation by Watching City-Tour VideosMingxuan Liu, Honglin He, Elisa Ricci, Wayne Wu 等ICLR 2026 · 被引用 8 次
它引用的顶会 Paper24
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt 等NeurIPS 2021 · 被引用 2,500 次
相关 Paper
- Neural Lighting Simulation for Urban ScenesAva Pun, Gary Sun, Jingkang Wang, Yun Chen 等NeurIPS 2023 · 被引用 11 次
- Wanderland: Geometrically Grounded Simulation for Open-World Embodied AIXinhao Liu, Jiaqi Li, Youming Deng, Ruxin Chen 等CVPR 2026 · 被引用 5 次
- Learning 3D Particle-based Simulators from RGB-D VideosWilliam F. Whitney, Tatiana Lopez-Guevara, Tobias Pfaff, Yulia Rubanova 等ICLR 2024 · 被引用 16 次
- No RL, No Simulation: Learning to Navigate without NavigatingMeera Hahn, Devendra Singh Chaplot, Shubham Tulsiani, Mustafa Mukadam 等NeurIPS 2021 · 被引用 98 次
- Contact-guided Real2Sim from Monocular Video with Planar Scene PrimitivesZihan Wang, Jiashun Wang, Jeff Tan, Yiwen Zhao 等ICLR 2026
