SDGS: Spatial Difference Guided Gaussian Splatting for Simultaneous Localization and 3D Reconstruction
Yijian Tian, Mingtao Ou, Pan Zijian, Xinglong Ji
Abstract
3D Gaussian Splatting (3DGS) has recently emerged as a powerful explicit 3D representation, enabling photorealistic and real-time novel view synthesis. However, most 3DGS pipelines still assume precomputed camera poses and offline optimization, which introduces latency and makes them brittle in fast-motion, real-world scenarios. Existing online 3DGS systems mostly fall into two camps: (1) hybrid systems that rely on a separate traditional SLAM system for camera poses and optimize Gaussians decoupled from tracking, increasing system complexity; and (2) purely Gaussian-based systems that estimate poses from dense photometric errors, requiring repeated rendering of a large number of Gaussians and thus incurring high computational cost. Moreover, current online methods are often sensitive to motion blur and high dynamic range scenes, limiting their applicability in practice.We address these limitations with a sparse, edge-guided online 3DGS framework. Our method represents the scene as an edge-aligned sparse Gaussian map and estimates 6-DoF camera poses by aligning rendered 3D edges with observed 2D edges using a distance transform based objective, yielding roughly 2× faster per-iteration pose optimization than existing Gaussian-based systems while recovering clear scene geometry. We further leverage a dual-channel hybrid pixel vision sensor that outputs blur-free, high-frame-rate spatial-difference edge signals alongside RGB images, and use these signals both for robust edge-based tracking and for a mutual supervision scheme that mitigates motion blur in dense 3D reconstruction. Our system maintains stable tracking and high-fidelity geometry under extremely high-speed motion, where existing RGB-only methods fail, while remaining compatible with standard RGB cameras and achieving competitive tracking accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 83442c67-a3c4-4c1c-ab8a-333ff202e859Builds on12
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger et al.SIGGRAPH 2024 · 660 citations
- Gaussian Splatting SLAMHidenobu Matsuki, Riku Murai, Paul H. J. Kelly, Andrew J. DavisonCVPR 2024 · 328 citations
- GS-SLAM: Dense Visual SLAM with 3D Gaussian SplattingChi Yan, Delin Qu, Dan Xu, Bin Zhao et al.CVPR 2024 · 270 citations
- VGGSfM: Visual Geometry Grounded Deep Structure from MotionJianyuan Wang, Nikita Karaev, Christian Rupprecht, David NovotnýCVPR 2024 · 48 citations
Related papers
- MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian SplattingRuijie Zhu, Yanzhe Liang, Hanzhi Chang, Jiacheng Deng et al.NeurIPS 2024 · 87 citations
- SpikeGS: Reconstruct 3D Scene Captured by a Fast-Moving Bio-Inspired CameraYijia Guo, Liwen Hu, Yuanxi Bai, Jiawei Yao et al.AAAI 2025 · 2 citations
- Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian PointmapsChong Cheng, Sicheng Yu, Zijian Wang, Yifan Zhou et al.ICCV 2025 · 4 citations
- Event-3DGS: Event-based 3D Reconstruction Using 3D Gaussian SplattingHaiqian Han, Jianing Li, Henglu Wei, Xiangyang JiNeurIPS 2024 · 39 citations
- StreamGS: Online Generalizable Gaussian Splatting Reconstruction for Unposed Image StreamsYang Li, Jinglu Wang, Lei Chu, Xiao Li et al.ICCV 2025 · 3 citations
