Differentiable Laplacian Matrix Guided Superpixel Segmentation
Jeremy Juybari, Josh Hamilton, Shuvra Das, Chaofan Chen, Andre Khalil, Yifeng Zhu
Abstract
Superpixels partition an image into perceptually coherent regions, reducing the cost of downstream vision tasks. Modern deep learning methods excel at superpixel generation but often yield irregular boundaries and isolated pixels, necessitating non-differentiable post-processing to enforce connectivity. This undermines the end-to-end learning capabilities. We propose a simple, fully differentiable graph-Laplacian loss that encourages spatial regularity and connectivity during training. The loss is model-agnostic and can be seamlessly integrated into the training of existing architectures to improve the quality of superpixels. In addition, we introduce two novel metrics, the average stray pixel count and excess component count, to measure the quality of superpixels. We demonstrate both qualitative and quantitative improvements over state-of-the-art methods with and without enforced connectivity. Our approach represents a significant step toward eliminating non-differentiable post-processing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on4
- p-Laplacian Based Graph Neural NetworksGuoji Fu, Peilin Zhao, Yatao BianICML 2022 · 53 citations
- AINet: Association Implantation for Superpixel SegmentationYaxiong Wang, Yunchao Wei, Xueming Qian, Li Zhu et al.ICCV 2021 · 23 citations
- Learning Invariant Inter-pixel Correlations for Superpixel GenerationSen Xu, Shikui Wei, Tao Ruan, Lixin LiaoAAAI 2024 · 14 citations
- Superpixel Segmentation With Fully Convolutional NetworksFengting Yang, Qian Sun, Hailin Jin, Zihan ZhouCVPR 2020
Related papers
- Physically-Aware Generative Network for 3D Shape ModelingMariem Mezghanni, Malika Boulkenafed, André Lieutier, Maks OvsjanikovCVPR 2021
- Robust Trust Region for Weakly Supervised SegmentationDmitrii Marin, Yuri BoykovICCV 2021 · 4 citations
- Learning Graph Regularisation for Guided Super-ResolutionRiccardo de Lutio, Alexander Becker, Stefano D'Aronco, Stefania Russo et al.CVPR 2022 · 40 citations
- Discrete Cycle-Consistency Based Unsupervised Deep Graph MatchingSiddharth Tourani, Muhammad Haris Khan, Carsten Rother, Bogdan SavchynskyyAAAI 2024 · 5 citations
- FSNet: Frequency Domain Guided Superpixel Segmentation Network for Complex ScenesHua Li, Junyan Liang, Wenjie Li, Wenhui WuACM MM 2023 · 9 citations
