Faster 3D Gaussian Splatting Convergence via Structure-Aware Densification
Linjie Lyu, Ayush Tewari, Jianchun Chen, Thomas Leimkühler, Christian Theobalt
Abstract
3D Gaussian Splatting has emerged as a powerful scene representation for real-time novel-view synthesis. However, its standard adaptive density control relies on screen-space positional gradients, which do not distinguish between geometric misplacement and frequency aliasing, often leading to either over-blurred high-frequency textures or inefficient over-densification. We present a structure-aware densification framework. Our key insight is that the decision to subdivide a Gaussian should be driven by an explicit comparison between its projected screen-space extent and the local structure of the texture it seeks to represent. We introduce a multi-scale frequency analysis combining structure tensors with Laplacian scale space analysis to estimate the dominant frequency at each pixel, enabling robust supervision across varying texture scales. Based on this analysis, we define η, a per-Gaussian, per-axis frequency violation metric that indicates when a primitive may be under-resolving local texture details. Unlike methods that perform isotropic splitting (e.g., splitting each Gaussian into two smaller ones with uniform shape), our approach performs anisotropic splitting. For each axis with high η, we compute a split factor to better resolve the local frequency content. We further introduce a multiview consistency criterion that aggregates η observations across multiple views. By performing densification early and faster, we skip the lengthy iterative densification phases required by baseline methods and achieve significantly faster convergence. Experiments on standard benchmarks demonstrate that our method also achieves superior reconstruction quality, particularly in high-frequency regions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d23ec1a6-eff7-4a13-9f58-ee14c9edbf83Builds on15
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPSZhiwen Fan, Kevin Wang, Kairun Wen, Zehao Zhu et al.NeurIPS 2024 · 681 citations
- Mip-Splatting: Alias-Free 3D Gaussian SplattingZehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler et al.CVPR 2024 · 360 citations
- 3D Gaussian Splatting as Markov Chain Monte CarloShakiba Kheradmand, Daniel Rebain, Gopal Sharma, Weiwei Sun et al.NeurIPS 2024 · 285 citations
Related papers
- Signal Structure-Aware Gaussian Splatting for Large-Scale Scene ReconstructionWeiyi Xue, Fan Lu, Chi Zhang, Tianhang Wang et al.ICLR 2026
- FreGS: 3D Gaussian Splatting with Progressive Frequency RegularizationJiahui Zhang, Fangneng Zhan, Muyu Xu, Shijian Lu et al.CVPR 2024 · 61 citations
- Frequency-Aware Density Control via Reparameterization for High-Quality Rendering of 3D Gaussian SplattingZhaojie Zeng, Yuesong Wang, Lili Ju, Tao GuanAAAI 2025 · 9 citations
- Gradient-Direction-Aware Density Control for 3D Gaussian SplattingZheng Zhou, Yu-Jie Xiong, Jia-Chen Zhang, Chun-Ming Xia et al.ICLR 2026 · 8 citations
- Resgs: Residual Densification of 3D Gaussian for Efficient Detail RecoveryYanzhe Lyu, Kai Cheng, Xin Kang, Xuejin ChenICCV 2025 · 5 citations
