CalM: A Self-Supervised Foundation Model for Population Dynamics in Calcium Imaging Data
Xinhong Xu, Yimeng Zhang, Qichen Qian, Yuanlong Zhang
摘要
Recent work suggests that large-scale, multianimal modeling can significantly improve neural recording analysis. However, for functional calcium traces, existing approaches remain taskspecific, limiting transfer across common neuroscience objectives. To address this challenge, we propose CalM, a self-supervised neural foundation model trained solely on neuronal calcium traces and adaptable to multiple downstream tasks, including forecasting and decoding. Our key contribution is a pretraining framework, composed of a high-performance tokenizer mapping singleneuron traces into a shared discrete vocabulary, and a dual-axis autoregressive transformer modeling dependencies along both the neural and the temporal axis. We evaluate CalM on a large-scale, multi-animal, multi-session dataset. On the neural population dynamics forecasting task, CalM achieves competitive performance against strong specialized baselines after pretraining. With a task-specific head, CalM further adapts to the behavior decoding task and achieves superior results compared with supervised decoding models. Moreover, linear analyses of CalM representations reveal interpretable functional structures beyond predictive accuracy. Taken together, we propose a novel and effective self-supervised pretraining paradigm for foundation models based on calcium traces, paving the way for scalable pretraining and broad applications in functional neural analysis. Code is released at https: //github.com/TSuXinH/CalM .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 被引用 64,255 次
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu 等ICLR 2024 · 被引用 1,703 次
- Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale PredictionKeyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng 等NeurIPS 2024 · 被引用 1,199 次
- A Time Series is Worth 64 Words: Long-term Forecasting with TransformersYuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, Jayant KalagnanamICLR 2023 · 被引用 536 次
- A Unified, Scalable Framework for Neural Population DecodingMehdi Azabou, Vinam Arora, Venkataramana Ganesh, Ximeng Mao 等NeurIPS 2023 · 被引用 136 次
相关 Paper
- Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal TokenizationMohammad Hosseini, Eray Erturk, Saba Hashemi, Maryam ShanechiICML 2026 · 被引用 1 次
- POCO: Scalable Neural Forecasting through Population ConditioningYu Duan, Hamza Tahir Chaudhry, Misha B. Ahrens, Christopher D. Harvey 等NeurIPS 2025 · 被引用 8 次
- BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural ActivityLucine L. Oganesian, Saba Hashemi, Maryam M. ShanechiNeurIPS 2025 · 被引用 7 次
- Towards a "Universal Translator" for Neural Dynamics at Single-Cell, Single-Spike ResolutionYizi Zhang, Yanchen Wang, Donato Jiménez-Benetó, Zixuan Wang 等NeurIPS 2024 · 被引用 59 次
- Know Thyself by Knowing Others: Learning Neuron Identity from Population ContextVinam Arora, Divyansha Lachi, Ian Jarratt Knight, Mehdi Azabou 等NeurIPS 2025 · 被引用 3 次
