SLVR: Super-Light Visual Reconstruction via Blueprint Controllable Convolutions and Exploring Feature Diversity Representation
Ning Ni, Libao Zhang
Abstract
Recently, improving the residual structure and designing efficient convolutions have become important branches of lightweight visual reconstruction model design. We have observed that the feature addition mode (FAM) in existing residual structure tends to lead to slow feature learning or stagnation in feature evolution, a phenomenon we define as network inertia. In addition, although blueprint separable convolutions (BSConv) have proved the dominance of intrakernel correlation, BSConv forces the blueprint to perform scale transformation on all channels, which may lead to incorrect intra-kernel correlation and introduce useless or disruptive features on some channels and hinder the effective propagation of features. Therefore, in this paper, we rethink the FAM and BSConv for super-light visual reconstruction framework design. First, we design a novel linking mode, called feature diversity evolution link (FDEL), which aims to alleviate the phenomenon of network inertia by reducing the retention of previous low-level features, thereby promoting the evolution of feature diversity. Second, we propose blueprint controllable convolutions (B2Conv). The B2Conv can adaptively pick accurate intra-kernel correlation in the depth-axis, effectively preventing the introduction of useless or disruptive features. Based on FDEL and B2Conv, we develop a super-light super-resolution (SR) framework SLVR for visual reconstruction. Both FDEL and B2Conv can serve as efficient plugins. Extensive experimental results demonstrate the effectiveness of our proposed B2Conv, FDEL, and SLVR. Our code will be available at https://github.com/chongningni/SLVR .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7ba8d8ac-69a1-441b-9252-b33b5bcca15dCited by top-tier papers1
Ask how each one uses itBuilds on12
- Free-Form Image Inpainting With Gated ConvolutionJiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen et al.ICCV 2019 · 1,990 citations
- Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave ConvolutionYunpeng Chen, Haoqi Fan, Bing Xu, Zhicheng Yan et al.ICCV 2019 · 665 citations
- LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-resolution and BeyondWenbo Li, Kun Zhou, Lu Qi, Nianjuan Jiang et al.NeurIPS 2020 · 293 citations
- Spatially-Adaptive Feature Modulation for Efficient Image Super-ResolutionLong Sun, Jiangxin Dong, Jinhui Tang, Jinshan PanICCV 2023 · 211 citations
- Feature Distillation Interaction Weighting Network for Lightweight Image Super-resolutionGuangwei Gao, Wenjie Li, Juncheng Li, Fei Wu et al.AAAI 2022 · 113 citations
Related papers
- Separable Modulation Network for Efficient Image Super-ResolutionZhijian Wu, Jun Li, Dingjiang HuangACM MM 2023 · 5 citations
- ShuffleMixer: An Efficient ConvNet for Image Super-ResolutionLong Sun, Jinshan Pan, Jinhui TangNeurIPS 2022 · 177 citations
- Learning Efficient Image Super-Resolution Networks via Structure-Regularized PruningYulun Zhang, Huan Wang, Can Qin, Yun FuICLR 2022 · 61 citations
- Structured Sparsity Learning for Efficient Video Super-ResolutionBin Xia, Jingwen He, Yulun Zhang, Yitong Wang et al.CVPR 2023
- PFFN: Progressive Feature Fusion Network for Lightweight Image Super-ResolutionDongyang Zhang, Changyu Li, Ning Xie, Guoqing Wang et al.ACM MM 2021 · 18 citations
