Few-shot Implicit Function Generation via Equivariance
Suizhi Huang, Xingyi Yang, Hongtao Lu, Xinchao Wang
Abstract
Implicit Neural Representations (INRs) have emerged as a powerful framework for representing continuous signals. However, generating diverse INR weights remains challenging due to limited training data. We introduce Few-shot Implicit Function Generation, a new problem setup that aims to generate diverse yet functionally consistent INR weights from only a few examples. This is challenging because even for the same signal, the optimal INRs can vary significantly depending on their initializations. To tackle this, we propose EQUIGEN, a framework that can generate new INRs from limited data. The core idea is that functionally similar networks can be transformed into one another through weight permutations, forming an equivariance group. By projecting these weights into an equivariant latent space, we enable diverse generation within these groups, even with few examples. EQUIGEN implements this through an equivariant encoder trained via contrastive learning and smooth augmentation, an equivariance-guided diffusion process, and controlled perturbations in the equivariant subspace. Experiments on 2D image and 3D shape INR datasets demonstrate that our approach effectively generates diverse INR weights while preserving their functional properties in few-shot scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d89914ba-3729-419f-9641-34ed259426cfCited by top-tier papers1
Ask how each one uses itBuilds on40
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
Related papers
- VI^3NR: Variance Informed Initialization for Implicit Neural RepresentationsChamin Hewa Koneputugodage, Yizhak Ben-Shabat, Sameera Ramasinghe, Stephen GouldCVPR 2025
- Implicit Representations via Operator LearningSourav Pal, Harshavardhan Adepu, Clinton J. Wang, Polina Golland et al.ICML 2024 · 4 citations
- Isometric Regularization for Manifolds of Functional DataHyeongjun Heo, Seonghun Oh, Jae Yong Lee, Young Min Kim et al.ICLR 2025
- DDMI: Domain-agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural RepresentationsDogyun Park, Sihyeon Kim, Sojin Lee, Hyunwoo J. KimICLR 2024 · 19 citations
- Deep Learning on Implicit Neural Representations of ShapesLuca De Luigi, Adriano Cardace, Riccardo Spezialetti, Pierluigi Zama Ramirez et al.ICLR 2023 · 8 citations
