NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization
Yik San Cheng, Runkai Zhao, Weidong Cai
Abstract
2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an analogous 3D foundation model for downstream volumetric neuroimaging remains lacking, largely due to the challenges of 3D image acquisition and the scarcity of high-quality annotations. To address this gap, we propose to adapt the 2D visual representations learned by DINOv3 to a 3D biomedical segmentation model, enabling more data-efficient and morphologically faithful neuronal reconstruction. Specifically, we design an inflation-based adaptation strategy that inflates 2D filters into 3D operators, preserving semantic priors from DINOv3 while adapting to 3D neuronal volume patches. In addition, we introduce a topology-aware skeleton loss to explicitly enforce structural fidelity of graph-based neuronal arbor reconstruction. Extensive experiments on four neuronal imaging datasets, including two from BigNeuron and two public datasets, NeuroFly and CWMBS, demonstrate consistent improvements in reconstruction accuracy over SoTA methods, with average gains of 2.9% in Entire Structure Average, 2.8% in Different Structure Average, and 3.8% in Percentage of Different Structure. Code: https://github.com/yy0007/NeurINO.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fb83a178-4c2f-45f6-83c8-5ca51a34f5aaBuilds on19
- GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-efficient Medical Image RecognitionShih-Cheng Huang, Liyue Shen, Matthew P. Lungren, Serena YeungICCV 2021 · 516 citations
- MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training for X-ray DiagnosisChaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang et al.ICCV 2023 · 205 citations
- UniverSeg: Universal Medical Image SegmentationVictor Ion Butoi, Jose Javier Gonzalez Ortiz, Tianyu Ma, Mert R. Sabuncu et al.ICCV 2023 · 163 citations
- BioCLIP: A Vision Foundation Model for the Tree of LifeSamuel Stevens, Jiaman Wu, Matthew J. Thompson, Elizabeth G. Campolongo et al.CVPR 2024 · 92 citations
- Joint Topology-preserving and Feature-refinement Network for Curvilinear Structure SegmentationMingfei Cheng, Kaili Zhao, Xuhong Guo, Yajing Xu et al.ICCV 2021 · 54 citations
Related papers
- LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting ScenesJuliette Marrie, Romain Menegaux, Michael Arbel, Diane Larlus et al.ICCV 2025 · 3 citations
- A Soma Segmentation Benchmark in Full Adult Fly BrainXiaoyu Liu, Bo Hu, Mingxing Li, Wei Huang et al.CVPR 2023
- Weakly Supervised 3D Open-vocabulary SegmentationKunhao Liu, Fangneng Zhan, Jiahui Zhang, Muyu Xu et al.NeurIPS 2023 · 173 citations
- 3DPoV: Improving 3D understanding via Patch Ordering on VideosIoana Simion, Mohammadreza Salehi, Shashanka Venkataramanan, Cees Snoek et al.ICML 2026
- vesselFM: A Foundation Model for Universal 3D Blood Vessel SegmentationBastian Wittmann, Yannick Wattenberg, Tamaz Amiranashvili, Suprosanna Shit et al.CVPR 2025
