Dense RGB Slam with Neural Implicit Maps
Heng Li, Xiaodong Gu, Weihao Yuan, Luwei Yang, Zilong Dong, Ping Tan
摘要
There is an emerging trend of using neural implicit functions for map representation in Simultaneous Localization and Mapping (SLAM). Some pioneer works have achieved encouraging results on RGB-D SLAM. In this paper, we present a dense RGB SLAM method with neural implicit map representation. To reach this challenging goal without depth input, we introduce a hierarchical feature volume to facilitate the implicit map decoder. This design effectively fuses shape cues across different scales to facilitate map reconstruction. Our method simultaneously solves the camera motion and the neural implicit map by matching the rendered and input video frames. To facilitate optimization, we further propose a photometric warping loss in the spirit of multi-view stereo to better constrain the camera pose and scene geometry. We evaluate our method on commonly used benchmarks and compare it with modern RGB and RGB-D SLAM systems. Our method achieves favorable results than previous methods and even surpasses some recent RGB-D SLAM methods. The code is at poptree.github.io/DIM-SLAM/.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper12
- Gaussian Splatting SLAMHidenobu Matsuki, Riku Murai, Paul H. J. Kelly, Andrew J. DavisonCVPR 2024 · 被引用 328 次
- Point-SLAM: Dense Neural Point Cloud-based SLAMErik Sandström, Yue Li, Luc Van Gool, Martin R. OswaldICCV 2023 · 被引用 269 次
- GO-SLAM: Global Optimization for Consistent 3D Instant ReconstructionYoumin Zhang, Fabio Tosi, Stefano Mattoccia, Matteo PoggiICCV 2023 · 被引用 208 次
- Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB VideosZiren Gong, Xiaohan Li, Fabio Tosi, Jiawei Han 等CVPR 2026 · 被引用 13 次
- Continuous Pose for Monocular Cameras in Neural Implicit RepresentationQi Ma, Danda Pani Paudel, Ajad Chhatkuli, Luc Van GoolCVPR 2024 · 被引用 3 次
它引用的顶会 Paper19
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman 等ICCV 2021 · 被引用 2,700 次
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt 等NeurIPS 2021 · 被引用 2,500 次
- PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human DigitizationShunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima 等ICCV 2019 · 被引用 1,411 次
- DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D CamerasZachary Teed, Jia DengNeurIPS 2021 · 被引用 1,248 次
相关 Paper
- NICE-SLAM: Neural Implicit Scalable Encoding for SLAMZihan Zhu, Songyou Peng, Viktor Larsson, Weiwei Xu 等CVPR 2022 · 被引用 720 次
- Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAMTongyan Hua, Lin WangCVPR 2024
- CP-SLAM: Collaborative Neural Point-based SLAM SystemJiarui Hu, Mao Mao, Hujun Bao, Guofeng Zhang 等NeurIPS 2023 · 被引用 65 次
- ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance FieldsMohammad Mahdi Johari, Camilla Carta, François FleuretCVPR 2023
- Query Quantized Neural SLAMSijia Jiang, Jing Hua, Zhizhong HanAAAI 2025
