TM-BSN: Triangular-Masked Blind-Spot Network for Real-World Self-Supervised Image Denoising
Junyoung Park, Youngjin Oh, Nam Ik Cho
摘要
Blind-spot networks (BSNs) enable self-supervised image denoising by preventing access to the target pixel, allowing clean signal estimation without ground-truth supervision. However, this approach assumes pixel-wise noise independence, which is violated in real-world sRGB images due to spatially correlated noise from the camera's image signal processing (ISP) pipeline. While several methods employ downsampling to decorrelate noise, they alter noise statistics and limit the network's ability to utilize full contextual information. In this paper, we propose the Triangular-Masked Blind-Spot Network (TM-BSN), a novel blind-spot architecture that accurately models the spatial correlation of real sRGB noise. This correlation originates from demosaicing, where each pixel is reconstructed from neighboring samples with spatially decaying weights, resulting in a diamond-shaped pattern. To align the receptive field with this geometry, we introduce a triangular-masked convolution that restricts the kernel to its upper-triangular region, creating a diamond-shaped blind spot at the original resolution. This design excludes correlated pixels while fully leveraging uncorrelated context, eliminating the need for downsampling or post-processing. Furthermore, we use knowledge distillation to transfer complementary knowledge from multiple blind-spot predictions into a lightweight U-Net, improving both accuracy and efficiency. Extensive experiments on real-world benchmarks demonstrate that our method achieves state-of-the-art performance, significantly outperforming existing self-supervised approaches. Our code is available at https://github.com/parkjun210/TM-BSN.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat 等CVPR 2022 · 被引用 3,348 次
- When AWGN-Based Denoiser Meets Real NoisesYuqian Zhou, Jianbo Jiao, Haibin Huang, Yang Wang 等AAAI 2020 · 被引用 169 次
- AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot NetworkWooseok Lee, Sanghyun Son, Kyoung Mu LeeCVPR 2022 · 被引用 148 次
- C2N: Practical Generative Noise Modeling for Real-World DenoisingGeonwoon Jang, Wooseok Lee, Sanghyun Son, Kyoung Mu LeeICCV 2021 · 被引用 109 次
- CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from ImageReyhaneh Neshatavar, Mohsen Yavartanoo, Sanghyun Son, Kyoung Mu LeeCVPR 2022 · 被引用 104 次
相关 Paper
- Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World ScenariosShiyan Chen, Jiyuan Zhang, Zhaofei Yu, Tiejun HuangCVPR 2024
- Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image DenoisingJunyi Li, Zhilu Zhang, Wangmeng ZuoAAAI 2025 · 被引用 31 次
- APR-RD: Complemental Two Steps for Self-Supervised Real Image DenoisingHyunjun Kim, Nam Ik ChoAAAI 2025 · 被引用 6 次
- Spatially Adaptive Self-Supervised Learning for Real-World Image DenoisingJunyi Li, Zhilu Zhang, Xiaoyu Liu, Chaoyu Feng 等CVPR 2023
- Self-supervised Image Denoising with Downsampled Invariance Loss and Conditional Blind-Spot NetworkYeong Il Jang, Keuntek Lee, Gu Yong Park, Seyun Kim 等ICCV 2023 · 被引用 29 次
