DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures
Xu Wang, Zhiru Wang, Shiyun Xie, Chengwei Pan, Yisong Chen
Abstract
3D Gaussian Splatting achieves real-time photo-realistic rendering but struggles when training images contain transient objects that violate multi-view consistency. Existing methods face a fundamental dilemma: accurate transient detection requires well-reconstructed static scenes, yet clean reconstruction depends on reliable transient masks. This circular dependency causes persistent artifacts when both components are jointly optimized from poor initialization. We present DualSplat, a two-stage framework which sidesteps this dilemma by first generating pseudo masks from reconstruction failures, then using them to guide clean scene optimization. We observe that transient objects manifest as incomplete fragments during initial training, since they appear in only a subset of views. We consolidate these failures into pseudo masks via instance-level thresholding and a feature-residual filter guided by SAM2 boundaries. Then we trains a clean 3DGS model under pseudo-mask supervision, with a lightweight MLP refining masks online by progressively shifting from pseudo-priors to self-consistency as densification proceeds. Experiments on RobustNeRF and NeRF On-the-Go demonstrate that DualSplat achieves competitive performance with recent methods, with particularly strong results on scenes with high transient density.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 17de9ea1-84ff-4278-9c27-e8b8f6703377Builds on30
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
Related papers
- RobustSplat: Decoupling Densification and Dynamics for Transient-Free 3DGSChuanyu Fu, Yuqi Zhang, Kunbin Yao, Guanying Chen et al.ICCV 2025 · 6 citations
- FastGS: Training 3D Gaussian Splatting in 100 SecondsShiwei Ren, Tianci Wen, Yongchun Fang, Biao LuCVPR 2026 · 55 citations
- Look at the Sky: Sky-Aware Efficient 3D Gaussian Splatting in the WildYuze Wang, Junyi Wang, Ruicheng Gao, Yansong Qu et al.IEEE VR 2025 · 21 citations
- DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-Free 3D ReconstructionRui Wang, Quentin Lohmeyer, Mirko Meboldt, Siyu TangICCV 2025 · 12 citations
- Rogsplat: Robust Gaussian Splatting Via Generative PriorsHanyang Kong, Xingyi Yang, Xinchao WangICCV 2025 · 5 citations
