CalM: A Self-Supervised Foundation Model for Population Dynamics in Calcium Imaging Data
Xinhong Xu, Yimeng Zhang, Qichen Qian, Yuanlong Zhang
Abstract
Recent work suggests that large-scale, multianimal modeling can significantly improve neural recording analysis. However, for functional calcium traces, existing approaches remain taskspecific, limiting transfer across common neuroscience objectives. To address this challenge, we propose CalM, a self-supervised neural foundation model trained solely on neuronal calcium traces and adaptable to multiple downstream tasks, including forecasting and decoding. Our key contribution is a pretraining framework, composed of a high-performance tokenizer mapping singleneuron traces into a shared discrete vocabulary, and a dual-axis autoregressive transformer modeling dependencies along both the neural and the temporal axis. We evaluate CalM on a large-scale, multi-animal, multi-session dataset. On the neural population dynamics forecasting task, CalM achieves competitive performance against strong specialized baselines after pretraining. With a task-specific head, CalM further adapts to the behavior decoding task and achieves superior results compared with supervised decoding models. Moreover, linear analyses of CalM representations reveal interpretable functional structures beyond predictive accuracy. Taken together, we propose a novel and effective self-supervised pretraining paradigm for foundation models based on calcium traces, paving the way for scalable pretraining and broad applications in functional neural analysis. Code is released at https: //github.com/TSuXinH/CalM .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1d298c0f-c03e-452c-b6e5-97eba21c8de6Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale PredictionKeyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng et al.NeurIPS 2024 · 1,199 citations
- A Time Series is Worth 64 Words: Long-term Forecasting with TransformersYuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, Jayant KalagnanamICLR 2023 · 536 citations
- A Unified, Scalable Framework for Neural Population DecodingMehdi Azabou, Vinam Arora, Venkataramana Ganesh, Ximeng Mao et al.NeurIPS 2023 · 136 citations
Related papers
- Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal TokenizationMohammad Hosseini, Eray Erturk, Saba Hashemi, Maryam ShanechiICML 2026 · 1 citation
- POCO: Scalable Neural Forecasting through Population ConditioningYu Duan, Hamza Tahir Chaudhry, Misha B. Ahrens, Christopher D. Harvey et al.NeurIPS 2025 · 8 citations
- BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural ActivityLucine L. Oganesian, Saba Hashemi, Maryam M. ShanechiNeurIPS 2025 · 7 citations
- Towards a "Universal Translator" for Neural Dynamics at Single-Cell, Single-Spike ResolutionYizi Zhang, Yanchen Wang, Donato Jiménez-Benetó, Zixuan Wang et al.NeurIPS 2024 · 59 citations
- Know Thyself by Knowing Others: Learning Neuron Identity from Population ContextVinam Arora, Divyansha Lachi, Ian Jarratt Knight, Mehdi Azabou et al.NeurIPS 2025 · 3 citations
