PlantRSR: A New Plant Dataset and Method for Reference-based Super-Resolution
Hongyang Zhou, Xiaobin Zhu, Shengxiang Yu, Liuling Chen, Jingyan Qin, Xu-Cheng Yin
Abstract
Single image super-resolution (SISR) often struggles to reconstruct highresolution (HR) details from heavily degraded low-resolution (LR) inputs. Instead, reference-based super-resolution (RefSR) methods offer an alternative solution to generate promising results using high-quality reference (Ref) images to guide reconstruction. However, existing RefSR datasets focus on limited scene types, primarily featuring human activities and architectural scenes. Plant scenes exhibit complex textures and fine details, essential for advancing RefSR in natural and highly detailed scenes. To this end, we meticulously captured and manually selected high-quality images containing rich textures to construct a largescale plant dataset, PlantRSR, comprising 16,585 HR-Ref pairs. The dataset captures the complexity and variability of plant scenes through extensive variations. In addition, we propose a novel RefSR method specifically designed to tackle the distinct challenges posed by plant imagery. It incorporates a Selective Key-Region Matching (SKRM) that selectively identifies and performs matching between LR and Ref images, focusing on distinctive botanical textures to improve matching efficiency. Additionally, a Texture-Guided Diffusion Module (TGDM) is proposed to refine LR textures by leveraging a diffusion process conditioned on the matched Ref textures. TGDM is effective in modeling irregular and fine textures, thereby facilitating more accurate SR results. The proposed method achieves significant improvements over state-of-the-art (SOTA) approaches on our PlantRSR dataset and other benchmarks. Code and dataset are released at: https://github.com/edbca/PlantRSR .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Autoregressive Image Generation without Vector QuantizationTianhong Li, Yonglong Tian, He Li, Mingyang Deng et al.NeurIPS 2024 · 758 citations
- One-Step Effective Diffusion Network for Real-World Image Super-ResolutionRongyuan Wu, Lingchen Sun, Zhiyuan Ma, Lei ZhangNeurIPS 2024 · 319 citations
- SinSR: Diffusion-Based Image Super-Resolution in a Single StepYufei Wang, Wenhan Yang, Xinyuan Chen, Yaohui Wang et al.CVPR 2024 · 110 citations
- Coarse-to-Fine Embedded PatchMatch and Multi-Scale Dynamic Aggregation for Reference-Based Super-resolutionBin Xia, Yapeng Tian, Yucheng Hang, Wenming Yang et al.AAAI 2022 · 34 citations
Related papers
- Reference-based Burst Super-resolutionSeonggwan Ko, Yeong Jun Koh, Donghyeon ChoACM MM 2024 · 2 citations
- MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-ResolutionLiying Lu, Wenbo Li, Xin Tao, Jiangbo Lu et al.CVPR 2021
- Task Decoupled Framework for Reference-based Super-ResolutionYixuan Huang, Xiaoyun Zhang, Yu Fu, Siheng Chen et al.CVPR 2022 · 34 citations
- LMR: A Large-Scale Multi-Reference Dataset for Reference-based Super-ResolutionLin Zhang, Xin Li, Dongliang He, Fu Li et al.ICCV 2023 · 23 citations
- Dual-Camera Super-Resolution with Aligned Attention ModulesTengfei Wang, Jiaxin Xie, Wenxiu Sun, Qiong Yan et al.ICCV 2021 · 58 citations
