EnerGS: Energy-Based Gaussian Splatting under Partial Geometric Priors
Rui Song, Tianhui Cai, Markus Gross, Yun Zhang, Walter Zimmer, Zhiyu Huang, Olaf Wysocki, Jiaqi Ma
Abstract
3D Gaussian Splatting (3DGS) has been widely adopted for scene reconstruction, where training inherently constitutes a highly coupled and non-convex optimization problem. Recent works commonly incorporate geometric priors, such as LiDAR measurements, either for initialization or as training constraints, with the goal of improving photometric reconstruction quality. However, in large-scale outdoor scenarios, such geometric supervision is often spatially incomplete and uneven, which limits its effectiveness as a reliable prior and can even be detrimental to the final reconstruction. To address this challenge, we model partially observable geometry as a continuous energy field induced by geometric evidence and propose EnerGS. Rather than enforcing geometry as a hard constraint, EnerGS provides a soft geometric guidance for the optimization of Gaussian primitives, allowing geometric information to steer the optimization process without directly restricting the solution space. Extensive experiments on large-scale outdoor scenes demonstrate that, under both sparse multi-view and monocular settings, EnerGS consistently improves photometric quality and geometric stability, while effectively mitigating overfitting during 3DGS training. The codebase is publicly available at: https://github.com/ucla-mobility/EnerGS.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on22
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger et al.SIGGRAPH 2024 · 660 citations
- 4D Gaussian Splatting for Real-Time Dynamic Scene RenderingGuanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie et al.CVPR 2024 · 513 citations
Related papers
- D2GS: Dense Depth Regularization for LiDAR-free Urban Scene ReconstructionKejing Xia, Jidong Jia, Ke Jin, Yucai Bai et al.NeurIPS 2025 · 3 citations
- MetroGS: Efficient and Stable Reconstruction of Geometrically Accurate High-Fidelity Large-Scale ScenesKehua Chen, Tianlu Mao, Xinzhu Ma, Hao Jiang et al.CVPR 2026 · 2 citations
- VAD-GS: Visibility-Aware Densification for 3D Gaussian Splatting in Dynamic Urban ScenesYikang Zhang, Rui FanCVPR 2026
- VA-GS: Enhancing the Geometric Representation of Gaussian Splatting via View AlignmentQing Li, Huifang Feng, Xun Gong, Yu-Shen LiuNeurIPS 2025 · 8 citations
- Energy-GS: Image Energy-guided Pose Alignment Gaussian Splatting with redesigned pose gradient flowYu Gao, Lutong Su, Ruixiang Huang, Tianji Jiang et al.CVPR 2026
