Local Texture Estimator for Implicit Representation Function
Jaewon Lee, Kyong Hwan Jin
Abstract
Recent works with an implicit neural function shed light on representing images in arbitrary resolution. However, a standalone multi-layer perceptron shows limited performance in learning high-frequency components. In this paper, we propose a Local Texture Estimator (LTE), a dominant-frequency estimator for natural images, enabling an implicit function to capture fine details while reconstructing images in a continuous manner. When jointly trained with a deep super-resolution (SR) architecture, LTE is capable of characterizing image textures in 2D Fourier space. We show that an LTE-based neural function achieves favorable performance against existing deep SR methods within an arbitrary-scale factor. Furthermore, we demonstrate that our implementation takes the shortest running time compared to previous works.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a472d55b-9616-45fa-acf1-078a137d7587Cited by top-tier papers57
- Implicit Neural Representation for Cooperative Low-light Image EnhancementShuzhou Yang, Moxuan Ding, Yanmin Wu, Zihan Li et al.ICCV 2023 · 224 citations
- Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian ModelingLong Peng, Anran Wu, Wenbo Li, Peizhe Xia et al.ICLR 2026 · 57 citations
- Fourier-enhanced Implicit Neural Fusion Network for Multispectral and Hyperspectral Image FusionYu-Jie Liang, Zihan Cao, Shangqi Deng, Hong-Xia Dou et al.NeurIPS 2024 · 40 citations
- Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale UpsamplingGuangyuan Li, Lei Zhao, Jiakai Sun, Zehua Lan et al.ICCV 2023 · 37 citations
- MoTIF: Learning Motion Trajectories with Local Implicit Neural Functions for Continuous Space-Time Video Super-ResolutionYi-Hsin Chen, Si-Cun Chen, Yi-Hsin Chen, Yen-Yu Lin et al.ICCV 2023 · 27 citations
Builds on11
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- How Neural Networks Extrapolate: From Feedforward to Graph Neural NetworksKeyulu Xu, Mozhi Zhang, Jingling Li, Simon Shaolei Du et al.ICLR 2021 · 364 citations
- Learning A Single Network for Scale-Arbitrary Super-ResolutionLongguang Wang, Yingqian Wang, Zaiping Lin, Jungang Yang et al.ICCV 2021 · 148 citations
Related papers
- Cascaded Local Implicit Transformer for Arbitrary-Scale Super-ResolutionHao-Wei Chen, Yu-Syuan Xu, Min-Fong Hong, Yi-Min Tsai et al.CVPR 2023
- Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-ResolutionJie-En Yao, Li-Yuan Tsao, Yi-Chen Lo, Roy Tseng et al.CVPR 2023
- Super-Resolution Neural OperatorMin Wei, Xuesong ZhangCVPR 2023
- Deep Fourier-based Arbitrary-scale Super-resolution for Real-time RenderingHaonan Zhang, Jie Guo, Jiawei Zhang, Haoyu Qin et al.SIGGRAPH 2024 · 9 citations
- Texture Fields: Learning Texture Representations in Function SpaceMichael Oechsle, Lars M. Mescheder, Michael Niemeyer, Thilo Strauss et al.ICCV 2019 · 334 citations
