TM-BSN: Triangular-Masked Blind-Spot Network for Real-World Self-Supervised Image Denoising
Junyoung Park, Youngjin Oh, Nam Ik Cho
Abstract
Blind-spot networks (BSNs) enable self-supervised image denoising by preventing access to the target pixel, allowing clean signal estimation without ground-truth supervision. However, this approach assumes pixel-wise noise independence, which is violated in real-world sRGB images due to spatially correlated noise from the camera's image signal processing (ISP) pipeline. While several methods employ downsampling to decorrelate noise, they alter noise statistics and limit the network's ability to utilize full contextual information. In this paper, we propose the Triangular-Masked Blind-Spot Network (TM-BSN), a novel blind-spot architecture that accurately models the spatial correlation of real sRGB noise. This correlation originates from demosaicing, where each pixel is reconstructed from neighboring samples with spatially decaying weights, resulting in a diamond-shaped pattern. To align the receptive field with this geometry, we introduce a triangular-masked convolution that restricts the kernel to its upper-triangular region, creating a diamond-shaped blind spot at the original resolution. This design excludes correlated pixels while fully leveraging uncorrelated context, eliminating the need for downsampling or post-processing. Furthermore, we use knowledge distillation to transfer complementary knowledge from multiple blind-spot predictions into a lightweight U-Net, improving both accuracy and efficiency. Extensive experiments on real-world benchmarks demonstrate that our method achieves state-of-the-art performance, significantly outperforming existing self-supervised approaches. Our code is available at https://github.com/parkjun210/TM-BSN.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext efe44285-b7a8-4516-a9a0-3ca4dc120b8cBuilds on18
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- When AWGN-Based Denoiser Meets Real NoisesYuqian Zhou, Jianbo Jiao, Haibin Huang, Yang Wang et al.AAAI 2020 · 169 citations
- AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot NetworkWooseok Lee, Sanghyun Son, Kyoung Mu LeeCVPR 2022 · 148 citations
- C2N: Practical Generative Noise Modeling for Real-World DenoisingGeonwoon Jang, Wooseok Lee, Sanghyun Son, Kyoung Mu LeeICCV 2021 · 109 citations
- CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from ImageReyhaneh Neshatavar, Mohsen Yavartanoo, Sanghyun Son, Kyoung Mu LeeCVPR 2022 · 104 citations
Related papers
- Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World ScenariosShiyan Chen, Jiyuan Zhang, Zhaofei Yu, Tiejun HuangCVPR 2024
- Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image DenoisingJunyi Li, Zhilu Zhang, Wangmeng ZuoAAAI 2025 · 31 citations
- APR-RD: Complemental Two Steps for Self-Supervised Real Image DenoisingHyunjun Kim, Nam Ik ChoAAAI 2025 · 6 citations
- Spatially Adaptive Self-Supervised Learning for Real-World Image DenoisingJunyi Li, Zhilu Zhang, Xiaoyu Liu, Chaoyu Feng et al.CVPR 2023
- Self-supervised Image Denoising with Downsampled Invariance Loss and Conditional Blind-Spot NetworkYeong Il Jang, Keuntek Lee, Gu Yong Park, Seyun Kim et al.ICCV 2023 · 29 citations
