Dual-Band Feature Fusion for Neural Global Illumination with Multi-Frequency Reflections
Shaohua Mo, Chuankun Zheng, Zihao Lin, Dianbing Xi, Qi Ye, Rui Wang, Hujun Bao, Yuchi Huo
Abstract
In this paper, we present a novel neural global illumination approach that enables multi-frequency reflections in dynamic scenes. Our method utilizes object-centric, spatial feature grids as the core framework to model rendering effects implicitly. A lightweight scene query, based on single-bounce ray tracing, is then performed on these feature grids to extract principal and secondary features separately. The principal features can capture a wide range of relatively low-frequency global illumination effects, such as diffuse indirect lighting and reflections on rough surfaces. In contrast, the secondary features can provide sparse scene-specific reflection details, typically with much higher frequencies than the final observed radiance. Inspired by the physical processes of light propagation, we introduce a novel dual-band feature fusion module that seamlessly blends these two types of features, generating fused features capable of modeling multi-frequency rendering effects. Additionally, we propose a two-stage training strategy tailored to accommodate the distinct characteristics of each feature type, significantly enhancing the overall quality and reducing artifacts in the rendered results. Experimental results demonstrate that our method delivers high-quality, multi-frequency dynamic reflections, outperforming state-of-the-art baselines, including path tracing with screen-space neural denoising and other neural global illumination methods.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 51d066de-de8d-4587-a730-113a9c6c9299Related papers
- Modeling Indirect Illumination for Inverse RenderingYuanqing Zhang, Jiaming Sun, Xingyi He, Huan Fu et al.CVPR 2022 · 140 citations
- Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance ModelingLiwen Wu, Sai Bi, Zexiang Xu, Fujun Luan et al.CVPR 2024 · 10 citations
- Ref-DGS: Reflective Dual Gaussian SplattingNingjing Fan, Yiqun Wang, Dong-Ming Yan, Peter WonkaSIGGRAPH 2026
- ENVIDR: Implicit Differentiable Renderer with Neural Environment LightingRuofan Liang, Huiting Chen, Chunlin Li, Fan Chen et al.ICCV 2023 · 72 citations
- Inverse Global Illumination using a Neural Radiometric PriorSaeed Hadadan, Geng Lin, Jan Novák, Fabrice Rousselle et al.SIGGRAPH 2023 · 7 citations
