Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework
Ruihua Chen, Yisi Luo, Bangyu Wu, Deyu Meng
Abstract
Full-waveform inversion (FWI) estimates physical parameters in the wave equation from limited measurements and has been widely applied in geophysical exploration, medical imaging, and non-destructive testing. Conventional FWI methods are limited by their notorious sensitivity to the accuracy of the initial models. Recent progress in continuous representation FWI (CR-FWI) demonstrates that representing parameter models with a coordinate-based neural network, such as implicit neural representation (INR), can mitigate the dependence on initial models. However, its underlying mechanism remains unclear, and INR-based FWI shows slower high-frequency convergence. In this work, we investigate the general CR-FWI framework and develop a unified theoretical understanding by extending the neural tangent kernel (NTK) for FWI to establish a wave-based NTK framework. Unlike standard NTK, our analysis reveals that wave-based NTK is not constant, both at initialization and during training, due to the inherent nonlinearity of FWI. We further show that the eigenvalue decay behavior of the wave-based NTK can explain why CR-FWI alleviates the dependency on initial models and shows slower high-frequency convergence. Building on these insights, we propose several CR-FWI methods with tailored eigenvalue decay properties for FWI, including a novel hybrid representation combining INR and multi-resolution grid (termed IG-FWI) that achieves a more balanced trade-off between robustness and high-frequency convergence rate. Applications in geophysical exploration on Marmousi, 2D SEG/EAGE Salt and Overthrust, 2004 BP model, and the more realistic 2014 Chevron models show the superior performance of our proposed methods compared to conventional FWI and existing INR-based FWI methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a6fff759-d132-46d7-93b7-28c4e2d9d829Builds on11
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- On the linearity of large non-linear models: when and why the tangent kernel is constantChaoyue Liu, Libin Zhu, Mikhail BelkinNeurIPS 2020 · 183 citations
- A Generalized Neural Tangent Kernel Analysis for Two-layer Neural NetworksZixiang Chen, Yuan Cao, Quanquan Gu, Tong ZhangNeurIPS 2020 · 82 citations
- Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a LoopPeng Jin, Xitong Zhang, Yinpeng Chen, Sharon Xiaolei Huang et al.ICLR 2022 · 63 citations
Related papers
- NTK-Guided Implicit Neural TeachingChen Zhang, Wei Zuo, Bingyang Cheng, Yikun Wang et al.CVPR 2026 · 3 citations
- A Structured Dictionary Perspective on Implicit Neural RepresentationsGizem Yüce, Guillermo Ortiz-Jiménez, Beril Besbinar, Pascal FrossardCVPR 2022 · 62 citations
- WIRE: Wavelet Implicit Neural RepresentationsVishwanath Saragadam, Daniel LeJeune, Jasper Tan, Guha Balakrishnan et al.CVPR 2023
- An Intriguing Property of Geophysics InversionYinan Feng, Yinpeng Chen, Shihang Feng, Peng Jin et al.ICML 2022 · 13 citations
- Batch Normalization Alleviates the Spectral Bias in Coordinate NetworksZhicheng Cai, Hao Zhu, Qiu Shen, Xinran Wang et al.CVPR 2024
