Diffusion Adversarial Representation Learning for Self-supervised Vessel Segmentation
Boah Kim, Yujin Oh, Jong Chul Ye
Abstract
Vessel segmentation in medical images is one of the important tasks in the diagnosis of vascular diseases and therapy planning. Although learning-based segmentation approaches have been extensively studied, a large amount of ground-truth labels are required in supervised methods and confusing background structures make neural networks hard to segment vessels in an unsupervised manner. To address this, here we introduce a novel diffusion adversarial representation learning (DARL) model that leverages a denoising diffusion probabilistic model with adversarial learning, and apply it to vessel segmentation. In particular, for self-supervised vessel segmentation, DARL learns the background signal using a diffusion module, which lets a generation module effectively provide vessel representations. Also, by adversarial learning based on the proposed switchable spatially-adaptive denormalization, our model estimates synthetic fake vessel images as well as vessel segmentation masks, which further makes the model capture vessel-relevant semantic information. Once the proposed model is trained, the model generates segmentation masks in a single step and can be applied to general vascular structure segmentation of coronary angiography and retinal images. Experimental results on various datasets show that our method significantly outperforms existing unsupervised and self-supervised vessel segmentation methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ef41f50b-fa42-4785-be1b-a259589b26f8Cited by top-tier papers15
- DiffusionDet: Diffusion Model for Object DetectionShoufa Chen, Peize Sun, Yibing Song, Ping LuoICCV 2023 · 715 citations
- MedSegDiff-V2: Diffusion-Based Medical Image Segmentation with TransformerJunde Wu, Wei Ji, Huazhu Fu, Min Xu et al.AAAI 2024 · 311 citations
- A Generalist Framework for Panoptic Segmentation of Images and VideosTing Chen, Lala Li, Saurabh Saxena, Geoffrey E. Hinton et al.ICCV 2023 · 140 citations
- DiffTAD: Temporal Action Detection with Proposal Denoising DiffusionSauradip Nag, Xiatian Zhu, Jiankang Deng, Yi-Zhe Song et al.ICCV 2023 · 34 citations
- DiffusionTrack: Point Set Diffusion Model for Visual Object TrackingFei Xie, Zhongdao Wang, Chao MaCVPR 2024 · 30 citations
Builds on10
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Palette: Image-to-Image Diffusion ModelsChitwan Saharia, William Chan, Huiwen Chang, Chris A. Lee et al.SIGGRAPH 2022 · 1,638 citations
- RePaint: Inpainting using Denoising Diffusion Probabilistic ModelsAndreas Lugmayr, Martin Danelljan, Andrés Romero, Fisher Yu et al.CVPR 2022 · 1,425 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Label-Efficient Semantic Segmentation with Diffusion ModelsDmitry Baranchuk, Andrey Voynov, Ivan Rubachev, Valentin Khrulkov et al.ICLR 2022 · 700 citations
Related papers
- Self-Supervised Vessel Segmentation via Adversarial LearningYuxin Ma, Yang Hua, Hanming Deng, Tao Song et al.ICCV 2021 · 72 citations
- VasoMIM: Vascular Anatomy-Aware Masked Image Modeling for Vessel SegmentationDe-Xing Huang, Xiao-Hu Zhou, Mei-Jiang Gui, Xiao-Liang Xie et al.AAAI 2026 · 2 citations
- Cerebrovascular Segmentation in TOF-MRA with Topology Regularization Adversarial ModelCheng Chen, Yunqing Chen, Shuang Song, Jianan Wang et al.ACM MM 2023 · 8 citations
- DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel SegmentationChun-Hung Wu, Shih-Hong Chen, Chih-Yao Hu, Hsin-Yu Wu et al.CVPR 2025
- vesselFM: A Foundation Model for Universal 3D Blood Vessel SegmentationBastian Wittmann, Yannick Wattenberg, Tamaz Amiranashvili, Suprosanna Shit et al.CVPR 2025
