INFER: Learning Implicit Neural Frequency Response Fields for Confined Acoustic Environments
Harshvardhan Takawale, Nirupam Roy, C. Phillip Brown
摘要
Neural acoustic fields often model time-domain impulse responses, which struggle to capture the frequency-selective wave behaviors that dominate confined, resonant environments. To address this, we propose INFER (Implicit Neural Frequency Response fields), a framework that directly learns continuous, complex-valued frequency response fields. Unlike prior time-domain methods, our frequency-first approach enables three key innovations: (1) end-to-end learning of frequency-specific attenuation and phase delay in 3D space; (2) a physics-based Kramers–Kronig consistency constraint that causally regularizes attenuation and phase delay; and (3) perceptual and hardware-aware spectral supervision that prioritizes critical auditory bands. We evaluate INFER across diverse settings, ranging from standard room-scale benchmarks (MeshRIR, RAF) to challenging, highly reverberant environments like real car cabins. Our approach significantly outperforms time- and hybrid-domain baselines, reducing average magnitude and phase reconstruction errors by over 39% and 51%, respectively, demonstrating state-of-the-art accuracy in modeling complex acoustic spaces.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil 等NeurIPS 2020 · 被引用 4,036 次
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt 等NeurIPS 2021 · 被引用 2,500 次
- Learning to Control PDEs with Differentiable PhysicsPhilipp Holl, Nils Thuerey, Vladlen KoltunICLR 2020 · 被引用 221 次
- Acorn: adaptive coordinate networks for neural scene representationJulien N. P. Martel, David B. Lindell, Connor Z. Lin, Eric R. Chan 等SIGGRAPH 2021 · 被引用 165 次
- Learning Neural Acoustic FieldsAndrew F. Luo, Yilun Du, Michael J. Tarr, Josh Tenenbaum 等NeurIPS 2022 · 被引用 153 次
相关 Paper
- Deep Neural Room Acoustics PrimitiveYuhang He, Anoop Cherian, Gordon Wichern, Andrew MarkhamICML 2024 · 被引用 6 次
- INRAS: Implicit Neural Representation for Audio ScenesKun Su, Mingfei Chen, Eli ShlizermanNeurIPS 2022 · 被引用 92 次
- Image2Reverb: Cross-Modal Reverb Impulse Response SynthesisNikhil Singh, Jeff Mentch, Jerry Ng, Matthew Beveridge 等ICCV 2021 · 被引用 61 次
- Multimodal Neural Acoustic Fields for Immersive Mixed RealityGuaneen Tong, Johnathan Chi-Ho Leung, Xi Peng, Haosheng Shi 等IEEE VR 2025 · 被引用 4 次
- Hearing Anything AnywhereMason Long Wang, Ryosuke Sawata, Samuel Clarke, Ruohan Gao 等CVPR 2024 · 被引用 6 次
