Abstract Rendering: Certified Rendering Under 3D Semantic Uncertainty
Chenxi Ji, Yangge Li, Xiangru Zhong, Huan Zhang, Sayan Mitra
Abstract
Rendering produces 2D images from 3D scene representations, yet how continuous variations in camera pose and scenes influence these images-and, consequently, downstream visual models-remains underexplored. We introduce abstract rendering, a framework that computes provable bounds on all images rendered under continuously varying camera poses and scenes. The resulting abstract image, expressed as a set of constraints over the image matrix, enables rigorous uncertainty propagation through downstream neural networks and thereby supports certification of model behavior under realistic 3D semantic perturbations, far beyond traditional pixel-level noise models. Our approach propagates camera pose uncertainty through each rendering step using efficient piecewise linear bounds, including custom abstractions for three rendering-specific operations-matrix inversion, sorting-based aggregation, and cumulative product summation-not supported by standard tools. Our implementation, ABSTRACTRENDER, targets two state-of-the-art photorealistic scene representations-3D Gaussian Splats and Neural Radiance Fields (NeRF)-and scales to complex scenes with up to 1M Gaussians. Our computed abstract images achieve up to 3% over-approximation error compared to sampling results (baseline). Through experiments on classification (ResNet), object detection (YOLO), and pose estimation (GATENet) tasks, we demonstrate that abstract rendering enables formal certification of downstream models under realistic 3D variations-an essential step toward safety-critical vision systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on10
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- AI2: Safety and Robustness Certification of Neural Networks with Abstract InterpretationTimon Gehr, Matthew Mirman, Dana Drachsler-Cohen, Petar Tsankov et al.S&P 2018 · 987 citations
- Nerfstudio: A Modular Framework for Neural Radiance Field DevelopmentMatthew Tancik, Ethan Weber, Evonne Ng, Ruilong Li et al.SIGGRAPH 2023 · 592 citations
- Automatic Perturbation Analysis for Scalable Certified Robustness and BeyondKaidi Xu, Zhouxing Shi, Huan Zhang, Yihan Wang et al.NeurIPS 2020 · 415 citations
- Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Neural Network Robustness VerificationShiqi Wang, Huan Zhang, Kaidi Xu, Xue Lin et al.NeurIPS 2021 · 359 citations
Related papers
- 4D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular VideosMengqi Guo, Bo Xu, Yanyan Li, Gim Hee LeeNeurIPS 2025 · 2 citations
- COLMAP-Free 3D Gaussian SplattingYang Fu, Xiaolong Wang, Sifei Liu, Amey Kulkarni et al.CVPR 2024
- 3D Geometry-aware Deformable Gaussian Splatting for Dynamic View SynthesisZhicheng Lu, Xiang Guo, Le Hui, Tianrui Chen et al.CVPR 2024 · 33 citations
- Deep Gaussian from Motion: Exploring 3D Geometric Foundation Models for Gaussian SplattingYu Chen, Rolandos Alexandros Potamias, Evangelos Ververas, Jifei Song et al.NeurIPS 2025
- HyRF: Hybrid Radiance Fields for Memory-efficient and High-quality Novel View SynthesisZipeng Wang, Dan XuNeurIPS 2025 · 5 citations
