Splat Feature Solver
Butian Xiong, Rong Liu, Kenneth Xu, Meida Chen, Andrew Feng
Abstract
Feature lifting has emerged as a crucial component in 3D scene understanding, enabling the attachment of rich image feature descriptors (e.g., DINO, CLIP) onto splat-based 3D representations. The core challenge lies in optimally assigning rich general attributes to 3D primitives while addressing the inconsistency issues from multi-view images. We present a unified, kernel- and feature-agnostic formulation of the feature lifting problem as a sparse linear inverse problem, which can be solved efficiently in closed form. Our approach admits a provable upper bound on the global optimal error under convex losses for delivering high quality lifted features. To address inconsistencies and noise in multi-view observations, we introduce two complementary regularization strategies to stabilize the solution and enhance semantic fidelity. Tikhonov Guidance enforces numerical stability through soft diagonal dominance, while Post-Lifting Aggregation filters noisy inputs via feature clustering. Extensive experiments demonstrate that our approach achieves state-of-the-art performance on open-vocabulary 3D segmentation benchmarks, outperforming training-based, grouping-based, and heuristic-forward baselines while producing lifted features in minutes. Our code is available in the blueGitHub. We provide additional bluewebsite for more visualization, as well as the bluevideo.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext abce8fe8-be9d-4d9b-abc7-f83c52e62363Cited by top-tier papers3
- ReLaGS: Relational Language Gaussian SplattingYaxu Xie, Abdalla Arafa, Alireza Javanmardi, Christen Millerdurai et al.CVPR 2026 · 7 citations
- Universal Beta SplattingRong Liu, Zhongpai Gao, Benjamin Planche, Meida Chen et al.ICLR 2026 · 4 citations
- Consistent Instance Field for Dynamic Scene UnderstandingJunyi Wu, Van Nguyen Nguyen, Benjamin Planche, Jiachen Tao et al.CVPR 2026 · 3 citations
Builds on23
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
Related papers
- Learning Compact 3D Representations from Feed-Forward Novel View SynthesisHonggyu An, Jaewoo Jung, Mungyeom Kim, Chaehyun Kim et al.CVPR 2026
- GAGS: Granularity-Aware Feature Distillation for Language Gaussian SplattingYuning Peng, Haiping Wang, Yuan Liu, Chenglu Wen et al.AAAI 2026 · 12 citations
- LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting ScenesJuliette Marrie, Romain Menegaux, Michael Arbel, Diane Larlus et al.ICCV 2025 · 3 citations
- FHGS: Feature-Homogenized Gaussian SplattingQigeng Duan, Benyun Zhao, Mingqiao Han, Yijun Huang et al.NeurIPS 2025 · 2 citations
- Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding RegistrationKim Jun-Seong, GeonU Kim, Kim Yu-Ji, Yu-Chiang Frank Wang et al.CVPR 2025
