Spatial-SAM: Spatially Consistent 3D Electron Microscopy Segmentation with SDF Memory and Semi-Supervised Learning
Yikai Huang, Renmin Han, Yuxuan Wang, Youcheng Cai, Ligang Liu
Abstract
Segment Anything Model (SAM)-based approaches have shown strong potential for biomedical image segmentation. However, these methods often struggle to preserve spatial consistency in 3D electron microscopy (3D-EM) data and still require extensive manual annotation. We propose Spatial-SAM, a spatially consistent and annotation-efficient framework for high-precision 3D-EM segmentation. It introduces a 3D Signed Distance Field (SDF) memory mechanism that replaces SAM2's memory with SDF representations precomputed by a 3D U-Net, providing richer geometric information and improving spatial consistency. It also combines SAM2's few-shot capability with a dual-track pseudo-label iterative optimization strategy to learn largescale 3D-EM segmentation from minimal annotations. Experiments show Spatial-SAM significantly outperforms existing semi-supervised methods and performs comparably to state-of-the-art fully supervised approaches on multiple 3D-EM benchmarks, reducing annotation costs while preserving spatial consistency. Code is available at https: //github.com/Giluir/Spatial-SAM .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3c9a54ef-55df-4026-a4e6-4de25d6ace01Builds on8
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- Semi-supervised Medical Image Segmentation through Dual-task ConsistencyXiangde Luo, Jieneng Chen, Tao Song, Guotai WangAAAI 2021 · 754 citations
- Sparse Object-level Supervision for Instance Segmentation with Pixel EmbeddingsAdrian Wolny, Qin Yu, Constantin Pape, Anna KreshukCVPR 2022 · 18 citations
- Adaptive Template Transformer for Mitochondria Segmentation in Electron Microscopy ImagesYuwen Pan, Naisong Luo, Rui Sun, Meng Meng et al.ICCV 2023 · 11 citations
- Electron Microscopy Images as Set of Fragments for Mitochondrial SegmentationNaisong Luo, Rui Sun, Yuwen Pan, Tianzhu Zhang et al.AAAI 2024 · 9 citations
Related papers
- FGNet: Leveraging Feature-Guided Attention to Refine SAM2 for 3D EM Neuron SegmentationZhenghua Li, Hang Chen, Zihao Sun, Kai Li et al.AAAI 2026
- Segment Anything Model Meets Semi-supervised Medical Image Segmentation: A Novel PerspectiveHaifeng Zhao, Haiyang Li, Lei-Lei Ma, Dengdi SunNeurIPS 2025 · 1 citation
- SSR-SAM: Retrieval-Style Segment Anything Model for Semi-Supervised Ultra-High-Resolution Image SegmentationShijie Li, Yiming Chen, Zhineng Chen, Kai Hu et al.AAAI 2026
- OFL-SAM2: Prompt SAM2 with Online Few-shot Learner for Efficient Medical Image SegmentationMeng Lan, Lefei Zhang, Xiaomeng LiAAAI 2026
- Point-SAM: Promptable 3D Segmentation Model for Point CloudsYuchen Zhou, Jiayuan Gu, Tung Yen Chiang, Fanbo Xiang et al.ICLR 2025
