Active Boundary Loss for Semantic Segmentation
Chi Wang, Yunke Zhang, Miaomiao Cui, Peiran Ren, Yin Yang, Xuansong Xie, Xian-Sheng Hua, Hujun Bao, Weiwei Xu
Abstract
This paper proposes a novel active boundary loss for semantic segmentation. It can progressively encourage the alignment between predicted boundaries and ground-truth boundaries during end-to-end training, which is not explicitly enforced in commonly used cross-entropy loss. Based on the predicted boundaries detected from the segmentation results using current network parameters, we formulate the boundary alignment problem as a differentiable direction vector prediction problem to guide the movement of predicted boundaries in each iteration. Our loss is model-agnostic and can be plugged in to the training of segmentation networks to improve the boundary details. Experimental results show that training with the active boundary loss can effectively improve the boundary F-score and mean Intersection-over-Union on challenging image and video object segmentation datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 095c3069-16b5-4516-86c5-73036155403dCited by top-tier papers10
- Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene SegmentationSanghun Jung, Jungsoo Lee, Daehoon Gwak, Sungha Choi et al.ICCV 2021 · 119 citations
- Semantic Diffusion Network for Semantic SegmentationHaoru Tan, Sitong Wu, Jimin PiNeurIPS 2022 · 62 citations
- Contextrast: Contextual Contrastive Learning for Semantic SegmentationChangki Sung, Wanhee Kim, Jungho An, Wooju Lee et al.CVPR 2024 · 29 citations
- IDRNet: Intervention-Driven Relation Network for Semantic SegmentationZhenchao Jin, Xiaowei Hu, Lingting Zhu, Luchuan Song et al.NeurIPS 2023 · 27 citations
- E-CRF: Embedded Conditional Random Field for Boundary-caused Class Weights Confusion in Semantic SegmentationJie Zhu, Huabin Huang, Banghuai Li, Leye WangICLR 2023 · 3 citations
Builds on8
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- Video Object Segmentation Using Space-Time Memory NetworksSeoung Wug Oh, Joon-Young Lee, Ning Xu, Seon Joo KimICCV 2019 · 845 citations
- Gated-SCNN: Gated Shape CNNs for Semantic SegmentationTowaki Takikawa, David Acuna, Varun Jampani, Sanja FidlerICCV 2019 · 710 citations
- Boundary-Aware Feature Propagation for Scene SegmentationHenghui Ding, Xudong Jiang, Ai Qun Liu, Nadia Magnenat-Thalmann et al.ICCV 2019 · 283 citations
- Selectivity or Invariance: Boundary-Aware Salient Object DetectionJinming Su, Jia Li, Yu Zhang, Changqun Xia et al.ICCV 2019 · 192 citations
Related papers
- InverseForm: A Loss Function for Structured Boundary-Aware SegmentationShubhankar Borse, Ying Wang, Yizhe Zhang, Fatih PorikliCVPR 2021
- Video Object Segmentation-aware Video Frame InterpolationJun-Sang Yoo, Hongjae Lee, Seung-Won JungICCV 2023 · 8 citations
- Pixel Exclusion: Uncertainty-aware Boundary Discovery for Active Cross-Domain Semantic SegmentationFuming You, Jingjing Li, Zhi Chen, Lei ZhuACM MM 2022 · 8 citations
- Semi-Supervised Semantic Segmentation With Directional Context-Aware ConsistencyXin Lai, Zhuotao Tian, Li Jiang, Shu Liu et al.CVPR 2021
- End-to-end Boundary Exploration for Weakly-supervised Semantic SegmentationJianjun Chen, Shancheng Fang, Hongtao Xie, Zheng-Jun Zha et al.ACM MM 2021 · 13 citations
