EVOS: Efficient Implicit Neural Training via EVOlutionary Selector
Weixiang Zhang, Shuzhao Xie, Chengwei Ren, Siyi Xie, Chen Tang, Shijia Ge, Mingzi Wang, Zhi Wang
Abstract
We propose EVOlutionary Selector (EVOS), an efficient training paradigm for accelerating Implicit Neural Representation (INR). Unlike conventional INR training that feeds all samples through the neural network in each iteration, our approach restricts training to strategically selected points, reducing computational overhead by eliminating redundant forward passes. Specifically, we treat each sample as an individual in an evolutionary process, where only those fittest ones survive and merit inclusion in training, adaptively evolving with the neural network dynamics. While this is conceptually similar to Evolutionary Algorithms, their distinct objectives (selection for acceleration vs. iterative solution optimization) require a fundamental redefinition of evolutionary mechanisms for our context. In response, we design sparse fitness evaluation, frequencyguided crossover, and augmented unbiased mutation to comprise EVOS. These components respectively guide sample selection with reduced computational cost, enhance performance through frequency-domain balance, and mitigate selection bias from cached evaluation. Extensive experiments demonstrate that our method achieves approximately 48%-66% reduction in training time while ensuring superior convergence without additional cost, establishing state-of-the-art acceleration among recent sampling-based strategies. Our code is available at this link.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cc35863c-3ff7-4e5f-acd6-aae0e4227e83Cited by top-tier papers5
- NTK-Guided Implicit Neural TeachingChen Zhang, Wei Zuo, Bingyang Cheng, Yikun Wang et al.CVPR 2026 · 3 citations
- Understanding Bias Terms in Neural RepresentationsWeixiang Zhang, Boxi Li, Shuzhao Xie, Chengwei Ren et al.NeurIPS 2025 · 2 citations
- Optimizing Rank for High-Fidelity Implicit Neural RepresentationsJulian McGinnis, Florian A. Hölzl, Suprosanna Shit, Florentin Bieder et al.ICML 2026
- SizeGS: Size-aware Compression of 3D Gaussian Splatting via Mixed Integer ProgrammingShuzhao Xie, Jiahang Liu, Weixiang Zhang, Shijia Ge et al.ACM MM 2025
- Inductive Gradient Adjustment for Spectral Bias in Implicit Neural RepresentationsKexuan Shi, Hai Chen, Leheng Zhang, Shuhang GuICML 2025
Builds on34
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Neural Sparse Voxel FieldsLingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua et al.NeurIPS 2020 · 1,535 citations
- KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPsChristian Reiser, Songyou Peng, Yiyi Liao, Andreas GeigerICCV 2021 · 963 citations
Related papers
- Nonparametric Teaching of Implicit Neural RepresentationsChen Zhang, Steven Tin Sui Luo, Jason Chun Lok Li, Yik-Chung Wu et al.ICML 2024 · 12 citations
- NeRM: Learning Neural Representations for High-Framerate Human Motion SynthesisDong Wei, Huaijiang Sun, Bin Li, Xiaoning Sun et al.ICLR 2024 · 8 citations
- DyRep: Bootstrapping Training with Dynamic Re-parameterizationTao Huang, Shan You, Bohan Zhang, Yuxuan Du et al.CVPR 2022 · 25 citations
- FINER: Flexible Spectral-Bias Tuning in Implicit NEural Representation by Variableperiodic Activation FunctionsZhen Liu, Hao Zhu, Qi Zhang, Jingde Fu et al.CVPR 2024
- Improved Implicit Neural Representation with Fourier Reparameterized TrainingKexuan Shi, Xingyu Zhou, Shuhang GuCVPR 2024 · 14 citations
