ASCENT: Annotation-Free Self-Supervised Contrastive Embeddings for 3D Neuron Tracking in Fluorescence Microscopy
Haejun Han, Hang Lu
Abstract
Abstract Tracking individual neurons in dense 3D microscopy recordings of fast-moving, deforming organisms is a critical challenge in neuroscience. This task is often hindered by complex tissue motion and the need for laborious manual annotation. Here, we introduce ASCENT, an annotation-free computational framework that learns robust representations of neuronal identity that are invariant to tissue deformation. ASCENT trains a Neuron Embedding Transformer (NETr) through a self-supervised contrastive scheme on augmented data that mimics tissue deformations. NETr generates highly discriminative embeddings for each neuron by combining visual appearance with positional information, refined by the context of all other neurons in the frame. On a challenging benchmark C. elegans datasets, ASCENT achieves state-of-the-art tracking accuracy, surpassing supervised methods. The method is robust to image noise, highly data-efficient, and generalizes across different imaging conditions. By eliminating the annotation bottleneck, ASCENT provides a practical and scalable solution for the robust analysis of whole-brain neural dynamics in behaving animals.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Scaling and Benchmarking Self-Supervised Visual Representation LearningPriya Goyal, Dhruv Mahajan, Abhinav Gupta, Ishan MisraICCV 2019 · 429 citations
Related papers
- Generalized and Invariant Single-Neuron In-Vivo Activity Representation LearningWei Wu, Yuxing Lu, Zhengrui Guo, Chi Zhang et al.NeurIPS 2025
- Know Thyself by Knowing Others: Learning Neuron Identity from Population ContextVinam Arora, Divyansha Lachi, Ian Jarratt Knight, Mehdi Azabou et al.NeurIPS 2025 · 3 citations
- Learning Time-Invariant Representations for Individual Neurons from Population DynamicsLu Mi, Trung Le, Tianxing He, Eli Shlizerman et al.NeurIPS 2023 · 15 citations
- Deformation-Aware Unpaired Image Translation for Pose Estimation on Laboratory AnimalsSiyuan Li, Semih Günel, Mirela Ostrek, Pavan Ramdya et al.CVPR 2020
- Animal behavioral analysis and neural encoding with transformer-based self-supervised pretrainingYanchen Wang, Han Yu, Ari Blau, Yizi Zhang et al.ICLR 2026 · 8 citations
