Generalizable Implicit Neural Representations via Instance Pattern Composers
Chiheon Kim, Doyup Lee, Saehoon Kim, Minsu Cho, Wook-Shin Han
Abstract
Despite recent advances in implicit neural representations (INRs), it remains challenging for a coordinate-based multi-layer perceptron (MLP) of INRs to learn a common representation across data instances and generalize it for unseen instances. In this work, we introduce a simple yet effective framework for generalizable INRs that enables a coordinate-based MLP to represent complex data instances by modulating only a small set of weights in an early MLP layer as an instance pattern composer; the remaining MLP weights learn pattern composition rules for common representations across instances. Our generalizable INR framework is fully compatible with existing meta-learning and hypernetworks in learning to predict the modulated weight for unseen instances. Extensive experiments demonstrate that our method achieves high performance on a wide range of domains such as an audio, image, and 3D object, while the ablation study validates our weight modulation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f6d5bf28-5c13-4b2e-9ef6-d7cce5668b39Cited by top-tier papers19
- Online Adaptation of Language Models with a Memory of Amortized ContextsJihoon Tack, Jaehyung Kim, Eric Mitchell, Jinwoo Shin et al.NeurIPS 2024 · 46 citations
- Locality-Aware Generalizable Implicit Neural RepresentationDoyup Lee, Chiheon Kim, Minsu Cho, Wook-Shin HanNeurIPS 2023 · 25 citations
- Generalizable Implicit Motion Modeling for Video Frame InterpolationZujin Guo, Wei Li, Chen Change LoyNeurIPS 2024 · 24 citations
- Learning Transferable Features for Implicit Neural RepresentationsKushal Kardam Vyas, Ahmed Imtiaz Humayun, Aniket Dashpute, Richard G. Baraniuk et al.NeurIPS 2024 · 18 citations
- CoLoRA: Continuous low-rank adaptation for reduced implicit neural modeling of parameterized partial differential equationsJules Berman, Benjamin PeherstorferICML 2024 · 17 citations
Builds on13
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- NeRV: Neural Representations for VideosHao Chen, Bo He, Hanyu Wang, Yixuan Ren et al.NeurIPS 2021 · 430 citations
Related papers
- Learned Initializations for Optimizing Coordinate-Based Neural RepresentationsMatthew Tancik, Ben Mildenhall, Terrance Wang, Divi Schmidt et al.CVPR 2021
- Foundation Models Secretly Understand Neural Network Weights: Enhancing Hypernetwork Architectures with Foundation ModelsJeffrey Gu, Serena Yeung-LevyICLR 2025
- HyperNVD: Accelerating Neural Video Decomposition via HypernetworksMaria Pilligua, Danna Xue, Javier Vazquez-CorralCVPR 2025
- Meta-Learning Sparse Implicit Neural RepresentationsJaeho Lee, Jihoon Tack, Namhoon Lee, Jinwoo ShinNeurIPS 2021 · 60 citations
- VI^3NR: Variance Informed Initialization for Implicit Neural RepresentationsChamin Hewa Koneputugodage, Yizhak Ben-Shabat, Sameera Ramasinghe, Stephen GouldCVPR 2025
