Inpainting the Neural Picture: Inferring Unrecorded Brain Area Dynamics from Multi-Animal Datasets
Ji Xia, Yizi Zhang, Shuqi Wang, Genevera I. Allen, Liam Paninski, Cole L. Hurwitz, Kenneth D. Miller
Abstract
Characterizing interactions between brain areas is a fundamental goal of systems neuroscience. While such analyses are possible when areas are recorded simultaneously, it is rare to observe all combinations of areas of interest within a single animal or recording session. How can we leverage multi-animal datasets to better understand multi-area interactions? Building on recent progress in large-scale, multi-animal models, we introduce NeuroPaint, a masked autoencoding approach for inferring the dynamics of unrecorded brain areas. By training across animals with overlapping subsets of recorded areas, NeuroPaint learns to reconstruct activity in missing areas based on shared structure across individuals. We train and evaluate our approach on synthetic data and two multi-animal, multi-area Neuropixels datasets. Our results demonstrate that models trained across animals with partial observations can successfully in-paint the dynamics of unrecorded areas, enabling 39th Conference on Neural Information Processing Systems (NeurIPS 2025). multi-area analyses that transcend the limitations of any single experiment. Code is available at the following github repository: NeuroPaint
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9921ff6d-d2bb-4a56-bd17-ee711bdf7f62Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Perceiver: General Perception with Iterative AttentionAndrew Jaegle, Felix Gimeno, Andy Brock, Oriol Vinyals et al.ICML 2021 · 1,399 citations
- Scatterbrain: Unifying Sparse and Low-rank AttentionBeidi Chen, Tri Dao, Eric Winsor, Zhao Song et al.NeurIPS 2021 · 165 citations
- A Unified, Scalable Framework for Neural Population DecodingMehdi Azabou, Vinam Arora, Venkataramana Ganesh, Ximeng Mao et al.NeurIPS 2023 · 136 citations
- Recurrent Switching Dynamical Systems Models for Multiple Interacting Neural PopulationsJoshua I. Glaser, Matthew R. Whiteway, John P. Cunningham, Liam Paninski et al.NeurIPS 2020 · 113 citations
- Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking ActivityJoel Ye, Jennifer L. Collinger, Leila Wehbe, Robert A. GauntNeurIPS 2023 · 100 citations
Related papers
- Towards a "Universal Translator" for Neural Dynamics at Single-Cell, Single-Spike ResolutionYizi Zhang, Yanchen Wang, Donato Jiménez-Benetó, Zixuan Wang et al.NeurIPS 2024 · 59 citations
- Neural Network Poisson Models for Behavioural and Neural Spike Train DataMoein Khajehnejad, Forough Habibollahi, Richard Nock, Ehsan Arabzadeh et al.ICML 2022 · 4 citations
- Coupled Transformer Autoencoder for Disentangling Multi-Region Neural Latent DynamicsRam Dyuthi Sristi, Sowmya Manojna Narasimha, Jingya Huang, Alice Despatin et al.ICLR 2026 · 1 citation
- Accurate Identification of Communication Between Multiple Interacting Neural PopulationsBelle Liu, Jacob Sacks, Matthew D. GolubICML 2025
- Learning dynamic representations of the functional connectome in neurobiological networksLuciano Dyballa, Samuel Lang, Alexandra Haslund-Gourley, Eviatar Yemini et al.ICLR 2024
