Learning Time-Invariant Representations for Individual Neurons from Population Dynamics
Lu Mi, Trung Le, Tianxing He, Eli Shlizerman, Uygar Sümbül
Abstract
Neurons can display highly variable dynamics. While such variability presumably supports the wide range of behaviors generated by the organism, their gene expressions are relatively stable in the adult brain. This suggests that neuronal activity is a combination of its time-invariant identity and the inputs the neuron receives from the rest of the circuit. Here, we propose a self-supervised learning based method to assign time-invariant representations to individual neurons based on permutation-, and population size-invariant summary of population recordings. We fit dynamical models to neuronal activity to learn a representation by considering the activity of both the individual and the neighboring population. Our self-supervised approach and use of implicit representations enable robust inference against imperfections such as partial overlap of neurons across sessions, trial-to-trial variability, and limited availability of molecular (transcriptomic) labels for downstream supervised tasks. We demonstrate our method on a public multimodal dataset of mouse cortical neuronal activity and transcriptomic labels. We report > 35% improvement in predicting the transcriptomic subclass identity and > 20% improvement in predicting class identity with respect to the state-of-the-art.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f93cedd9-7e10-4bd0-adde-fd2746fff8acCited by top-tier papers11
- OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural TokensKonstantin Friedrich Willeke, Polina Turishcheva, Alex Gilbert, Goirik Chakrabarty et al.ICLR 2026 · 10 citations
- SPINT: Spatial Permutation-Invariant Neural Transformer for Consistent Intracortical Motor DecodingTrung Le, Hao Fang, Jingyuan Li, Tung Nguyen et al.NeurIPS 2025 · 8 citations
- NOBLE - Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron ModelsLuca Ghafourpour, Valentin Duruisseaux, Bahareh Tolooshams, Philip H. Wong et al.NeurIPS 2025 · 7 citations
- From Synapses to Dynamics: Obtaining Function from Structure in a Connectome Constrained Model of the Head Direction CircuitSunny Duan, Ling L. Dong, Ila FieteNeurIPS 2025 · 5 citations
- Know Thyself by Knowing Others: Learning Neuron Identity from Population ContextVinam Arora, Divyansha Lachi, Ian Jarratt Knight, Mehdi Azabou et al.NeurIPS 2025 · 3 citations
Builds on3
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- STNDT: Modeling Neural Population Activity with Spatiotemporal TransformersTrung Le, Eli ShlizermanNeurIPS 2022 · 40 citations
- Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformersRan Liu, Mehdi Azabou, Max Dabagia, Jingyun Xiao et al.NeurIPS 2022 · 28 citations
Related papers
- ASCENT: Annotation-Free Self-Supervised Contrastive Embeddings for 3D Neuron Tracking in Fluorescence MicroscopyHaejun Han, Hang LuICCV 2025 · 1 citation
- Generalized and Invariant Single-Neuron In-Vivo Activity Representation LearningWei Wu, Yuxing Lu, Zhengrui Guo, Chi Zhang et al.NeurIPS 2025
- Towards a "Universal Translator" for Neural Dynamics at Single-Cell, Single-Spike ResolutionYizi Zhang, Yanchen Wang, Donato Jiménez-Benetó, Zixuan Wang et al.NeurIPS 2024 · 59 citations
- A Unified, Scalable Framework for Neural Population DecodingMehdi Azabou, Vinam Arora, Venkataramana Ganesh, Ximeng Mao et al.NeurIPS 2023 · 136 citations
- Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal TokenizationMohammad Hosseini, Eray Erturk, Saba Hashemi, Maryam ShanechiICML 2026 · 1 citation
