Generalised Implicit Neural Representations
Daniele Grattarola, Pierre Vandergheynst
Abstract
We consider the problem of learning implicit neural representations (INRs) for signals on non-Euclidean domains. In the Euclidean case, INRs are trained on a discrete sampling of a signal over a regular lattice. Here, we assume that the continuous signal exists on some unknown topological space from which we sample a discrete graph. In the absence of a coordinate system to identify the sampled nodes, we propose approximating their location with a spectral embedding of the graph. This allows us to train INRs without knowing the underlying continuous domain, which is the case for most graph signals in nature, while also making the INRs independent of any choice of coordinate system. We show experiments with our method on various real-world signals on non-Euclidean domains. Figure 1 : Given a continuous signal on a non-Euclidean domain, we observe a discrete graph realisation of it. A generalised implicit neural representation is a neural network f θ trained to map a spectral embedding of each node to the corresponding signal value.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 46fc9fde-1ef7-4ed0-9d94-0b99c6c7b3e2Cited by top-tier papers18
- Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation NetworksMarc Rußwurm, Konstantin Klemmer, Esther Rolf, Robin Zbinden et al.ICLR 2024 · 66 citations
- Swallowing the Bitter Pill: Simplified Scalable Conformer GenerationYuyang Wang, Ahmed A. A. Elhag, Navdeep Jaitly, Joshua M. Susskind et al.ICML 2024 · 55 citations
- Modality-Agnostic Variational Compression of Implicit Neural RepresentationsJonathan Richard Schwarz, Jihoon Tack, Yee Whye Teh, Jaeho Lee et al.ICML 2023 · 28 citations
- Pre-training Sequence, Structure, and Surface Features for Comprehensive Protein Representation LearningYouhan Lee, Hasun Yu, Jaemyung Lee, Jaehoon KimICLR 2024 · 22 citations
- Nonparametric Teaching of Implicit Neural RepresentationsChen Zhang, Steven Tin Sui Luo, Jason Chun Lok Li, Yik-Chung Wu et al.ICML 2024 · 12 citations
Builds on17
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Multiview Neural Surface Reconstruction by Disentangling Geometry and AppearanceLior Yariv, Yoni Kasten, Dror Moran, Meirav Galun et al.NeurIPS 2020 · 1,010 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
- Graph Neural Networks with Learnable Structural and Positional RepresentationsVijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio et al.ICLR 2022 · 464 citations
Related papers
- Implicit Neural Representations and the Algebra of Complex WaveletsT. Mitchell Roddenberry, Vishwanath Saragadam, Maarten V. de Hoop, Richard G. BaraniukICLR 2024 · 8 citations
- Meta-Learning Sparse Implicit Neural RepresentationsJaeho Lee, Jihoon Tack, Namhoon Lee, Jinwoo ShinNeurIPS 2021 · 60 citations
- DiGS : Divergence guided shape implicit neural representation for unoriented point cloudsYizhak Ben-Shabat, Chamin Hewa Koneputugodage, Stephen GouldCVPR 2022 · 69 citations
- Implicit Representations via Operator LearningSourav Pal, Harshavardhan Adepu, Clinton J. Wang, Polina Golland et al.ICML 2024 · 4 citations
- ReLUs Are Sufficient for Learning Implicit Neural RepresentationsJoseph Shenouda, Yamin Zhou, Robert D. NowakICML 2024 · 7 citations
