Dynamic Focused Masking for Autoregressive Embodied Occupancy Prediction
Yuan Sun, Julio Contreras, Jorge Ortiz
Abstract
Visual autoregressive modeling has recently demonstrated potential in image tasks by enabling coarse-to-fine, next-level prediction. Most indoor 3D occupancy prediction methods, however, continue to rely on dense voxel grids and convolution-heavy backbones, which incur high computational costs when applying such coarse-to-fine frameworks. In contrast, cost-efficient alternatives based on Gaussian rep-resentations—particularly in the context of multi-scale autoregression—remain underexplored. To bridge this gap, we propose DFGauss, a Dynamic Focused masking framework for multi-scale 3D Gaussian representation. Unlike conventional approaches that refine voxel volumes or 2D projections, DFGauss directly operates in the 3D Gaussian parameter space, progressively refining representations across resolutions under hierarchical supervision. Each finer-scale Gaussian is conditioned on its coarser-level counterpart, forming a scale-wise autoregressive process. To further enhance efficiency, we introduce an importance-guided refinement strategy that selectively propagates informative Gaussians across scales, enabling spatially adaptive detail modeling. Experiments on 3D occupancy benchmarks demonstrate that DFGauss achieves competitive performance, highlighting the promise of autoregressive modeling for scalable 3D occupancy prediction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d29d37ac-a2fa-4533-b753-7a967946f3b2Builds on25
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao et al.NeurIPS 2024 · 2,305 citations
- Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale PredictionKeyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng et al.NeurIPS 2024 · 1,199 citations
- LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPSZhiwen Fan, Kevin Wang, Kairun Wen, Zehao Zhu et al.NeurIPS 2024 · 681 citations
- SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous DrivingYi Wei, Linqing Zhao, Wenzhao Zheng, Zheng Zhu et al.ICCV 2023 · 380 citations
Related papers
- Progressive Gaussian Transformer with Anisotropy-aware Sampling for Open Vocabulary Occupancy PredictionChi Yan, Dan XuICLR 2026 · 6 citations
- OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree QueriesYuhang Lu, Xinge Zhu, Tai Wang, Yuexin MaNeurIPS 2024 · 70 citations
- GaussianFlowOcc: Sparse and Weakly Supervised Occupancy Estimation using Gaussian Splatting and Temporal FlowSimon Boeder, Fabian Gigengack, Benjamin RisseICCV 2025 · 28 citations
- ODG: Occupancy Prediction Using Dual GaussiansYunxiao Shi, Yinhao Zhu, Herbert Cai, Shizhong Han et al.NeurIPS 2025 · 7 citations
- Test-Time 3D Occupancy PredictionFengyi Zhang, Xiangyu Sun, Huitong Yang, Zheng Zhang et al.CVPR 2026 · 2 citations
