Mind marginal non-crack regions: Clustering-inspired representation learning for crack segmentation
Zhuangzhuang Chen, Zhuonan Lai, Jie Chen, Jianqiang Li
Abstract
Crack segmentation datasets make great efforts to obtain the ground truth crack or non-crack labels as clearly as possible. However, it can be observed that ambiguities are still inevitable when considering the marginal non-crack region, due to low contrast and heterogeneous texture. To solve this problem, we propose a novel clustering-inspired representation learning framework, which contains a twophase strategy for automatic crack segmentation. In the first phase, a pre-process is proposed to localize the marginal non-crack region. Then, we propose an ambiguity-aware segmentation loss (Aseg Loss) that enables crack segmentation models to capture ambiguities in the above regions via learning segmentation variance, which allows us to further localize ambiguous regions. In the second phase, to learn the discriminative features of the above regions, we propose a clustering-inspired loss (CI Loss) that alters the supervision learning of these regions into an unsupervised clustering manner. We demonstrate that the proposed method could surpass the existing crack segmentation models on various datasets and our constructed CrackSeg5k dataset.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers13
- Toward a Stable, Fair, and Comprehensive Evaluation of Object Hallucination in Large Vision-Language ModelsHongliang Wei, Xingtao Wang, Xianqi Zhang, Xiaopeng Fan et al.NeurIPS 2024 · 4 citations
- TopoTTA: Topology-Enhanced Test-Time Adaptation for Tubular Structure SegmentationJiale Zhou, Wenhan Wang, Shikun Li, Xiaolei Qu et al.ICCV 2025 · 2 citations
- Attack-inspired Calibration Loss for Calibrating Crack RecognitionZhuangzhuang Chen, Qiangyu Chen, Jiahao Zhang, Zhiliang Lin et al.AAAI 2025 · 2 citations
- LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural CracksHui Liu, Chen Jia, Fan Shi, Xu Cheng et al.ACM MM 2025 · 1 citation
- Wavelet and Prototype Augmented Query-based Transformer for Pixel-level Surface Defect DetectionFeng Yan, Xiaoheng Jiang, Yang Lu, Jiale Cao et al.CVPR 2025
Builds on13
- With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual RepresentationsDebidatta Dwibedi, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet et al.ICCV 2021 · 542 citations
- Attracting and Dispersing: A Simple Approach for Source-free Domain AdaptationShiqi Yang, Yaxing Wang, Kai Wang, Shangling Jui et al.NeurIPS 2022 · 221 citations
- CrackFormer: Transformer Network for Fine-Grained Crack DetectionHuajun Liu, Xiangyu Miao, Christoph Mertz, Chengzhong Xu et al.ICCV 2021 · 195 citations
- Deep Comprehensive Correlation Mining for Image ClusteringJianlong Wu, Keyu Long, Fei Wang, Chen Qian et al.ICCV 2019 · 191 citations
- PolyLoss: A Polynomial Expansion Perspective of Classification Loss FunctionsZhaoqi Leng, Mingxing Tan, Chenxi Liu, Ekin Dogus Cubuk et al.ICLR 2022 · 189 citations
Related papers
- Pseudo-Label Guided Contrastive Learning for Semi-Supervised Medical Image SegmentationHritam Basak, Zhaozheng YinCVPR 2023
- CoGenSAM: Codebook-Interactive Generative Labeling for Adapting SAM to Crack SegmentationZhuangzhuang Chen, Nuo Chen, Dachong Li, Zhiliang Lin et al.AAAI 2026
- Clustering by Maximizing Mutual Information Across ViewsKien Do, Truyen Tran, Svetha VenkateshICCV 2021 · 52 citations
- Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering TransformersTsung-Wei Ke, Jyh-Jing Hwang, Yunhui Guo, Xudong Wang et al.CVPR 2022 · 34 citations
- Texture Learning Domain Randomization for Domain Generalized SegmentationSunghwan Kim, Dae-Hwan Kim, Hoseong KimICCV 2023 · 39 citations
