NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization
Yik San Cheng, Runkai Zhao, Weidong Cai
摘要
2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an analogous 3D foundation model for downstream volumetric neuroimaging remains lacking, largely due to the challenges of 3D image acquisition and the scarcity of high-quality annotations. To address this gap, we propose to adapt the 2D visual representations learned by DINOv3 to a 3D biomedical segmentation model, enabling more data-efficient and morphologically faithful neuronal reconstruction. Specifically, we design an inflation-based adaptation strategy that inflates 2D filters into 3D operators, preserving semantic priors from DINOv3 while adapting to 3D neuronal volume patches. In addition, we introduce a topology-aware skeleton loss to explicitly enforce structural fidelity of graph-based neuronal arbor reconstruction. Extensive experiments on four neuronal imaging datasets, including two from BigNeuron and two public datasets, NeuroFly and CWMBS, demonstrate consistent improvements in reconstruction accuracy over SoTA methods, with average gains of 2.9% in Entire Structure Average, 2.8% in Different Structure Average, and 3.8% in Percentage of Different Structure. Code: https://github.com/yy0007/NeurINO.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-efficient Medical Image RecognitionShih-Cheng Huang, Liyue Shen, Matthew P. Lungren, Serena YeungICCV 2021 · 被引用 516 次
- MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training for X-ray DiagnosisChaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang 等ICCV 2023 · 被引用 205 次
- UniverSeg: Universal Medical Image SegmentationVictor Ion Butoi, Jose Javier Gonzalez Ortiz, Tianyu Ma, Mert R. Sabuncu 等ICCV 2023 · 被引用 163 次
- BioCLIP: A Vision Foundation Model for the Tree of LifeSamuel Stevens, Jiaman Wu, Matthew J. Thompson, Elizabeth G. Campolongo 等CVPR 2024 · 被引用 92 次
- Joint Topology-preserving and Feature-refinement Network for Curvilinear Structure SegmentationMingfei Cheng, Kaili Zhao, Xuhong Guo, Yajing Xu 等ICCV 2021 · 被引用 54 次
相关 Paper
- LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting ScenesJuliette Marrie, Romain Menegaux, Michael Arbel, Diane Larlus 等ICCV 2025 · 被引用 3 次
- A Soma Segmentation Benchmark in Full Adult Fly BrainXiaoyu Liu, Bo Hu, Mingxing Li, Wei Huang 等CVPR 2023
- Weakly Supervised 3D Open-vocabulary SegmentationKunhao Liu, Fangneng Zhan, Jiahui Zhang, Muyu Xu 等NeurIPS 2023 · 被引用 173 次
- 3DPoV: Improving 3D understanding via Patch Ordering on VideosIoana Simion, Mohammadreza Salehi, Shashanka Venkataramanan, Cees Snoek 等ICML 2026
- vesselFM: A Foundation Model for Universal 3D Blood Vessel SegmentationBastian Wittmann, Yannick Wattenberg, Tamaz Amiranashvili, Suprosanna Shit 等CVPR 2025
