Extracting computational mechanisms from neural data using low-rank RNNs
Adrian Valente, Jonathan W. Pillow, Srdjan Ostojic
Abstract
An influential framework within systems neuroscience posits that neural computations can be understood in terms of low-dimensional dynamics in recurrent circuits. A number of methods have thus been developed to extract latent dynamical systems from neural recordings, but inferring models that are both predictive and interpretable remains a difficult challenge. Here we propose a new method called Low-rank Inference from Neural Trajectories (LINT), based on a class of low-rank recurrent neural networks (lrRNNs) for which a link between connectivity and dynamics has been previously demonstrated. By fitting such networks to trajectories of neural activity, LINT yields a mechanistic model of latent dynamics, as well as a set of axes for dimensionality reduction and verifiable predictions for inactivations of specific populations of neurons. Here, we first demonstrate the consistency of our method and then apply it to two use cases: (i) we reverse-engineer "black-box" vanilla RNNs trained to perform cognitive tasks, and (ii) we infer latent dynamics and neural contributions from electrophysiological recordings of nonhuman primates performing a similar task.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 072c1d16-2fc4-4abc-9dee-7dd1a73e8e90Cited by top-tier papers17
- Inferring stochastic low-rank recurrent neural networks from neural dataMatthijs Pals, A Erdem Sagtekin, Felix Pei, Manuel Glöckler et al.NeurIPS 2024 · 37 citations
- Low Tensor Rank Learning of Neural DynamicsArthur Pellegrino, N. Alex Cayco-Gajic, Angus ChadwickNeurIPS 2023 · 26 citations
- Training biologically plausible recurrent neural networks on cognitive tasks with long-term dependenciesWayne Soo, Vishwa Goudar, Xiao-Jing WangNeurIPS 2023 · 16 citations
- CORNN: Convex optimization of recurrent neural networks for rapid inference of neural dynamicsFatih Dinc, Adam Shai, Mark J. Schnitzer, Hidenori TanakaNeurIPS 2023 · 14 citations
- Trial matching: capturing variability with data-constrained spiking neural networksChristos Sourmpis, Carl C. H. Petersen, Wulfram Gerstner, Guillaume BellecNeurIPS 2023 · 9 citations
Builds on7
- Recurrent Switching Dynamical Systems Models for Multiple Interacting Neural PopulationsJoshua I. Glaser, Matthew R. Whiteway, John P. Cunningham, Liam Paninski et al.NeurIPS 2020 · 113 citations
- The interplay between randomness and structure during learning in RNNsFriedrich Schüßler, Francesca Mastrogiuseppe, Alexis M. Dubreuil, Srdjan Ostojic et al.NeurIPS 2020 · 91 citations
- Reverse-engineering recurrent neural network solutions to a hierarchical inference task for miceRylan Schaeffer, Mikail Khona, Leenoy Meshulam, International Brain Laboratory et al.NeurIPS 2020 · 49 citations
- Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systemsJimmy T. H. Smith, Scott W. Linderman, David SussilloNeurIPS 2021 · 44 citations
- iLQR-VAE : control-based learning of input-driven dynamics with applications to neural dataMarine Schimel, Ta-Chu Kao, Kristopher T. Jensen, Guillaume HennequinICLR 2022 · 40 citations
Related papers
- A Factorized Low-Rank RNN Framework for Uncovering Independent Neural Latent Dynamics and ConnectivityChengrui Li, Yunmiao Wang, Yule Wang, Weihan Li et al.ICML 2026 · 1 citation
- Identifying Connectivity Distributions from Neural Dynamics Using FlowsTimothy Kim, Ulises Obilinovic, Yiliu Wang, Eric SheaBrown et al.ICML 2026 · 1 citation
- Flow-field inference from neural data using deep recurrent networksTimothy Doyeon Kim, Thomas Zhihao Luo, Tankut Can, Kamesh Krishnamurthy et al.ICML 2025
- High-dimensional neuronal activity from low-dimensional latent dynamics: a solvable modelValentin Schmutz, Ali Haydaroglu, Shuqi Wang, Yixiao Feng et al.NeurIPS 2025 · 9 citations
- Inferring Latent Dynamics Underlying Neural Population Activity via Neural Differential EquationsTimothy Doyeon Kim, Thomas Zhihao Luo, Jonathan W. Pillow, Carlos D. BrodyICML 2021 · 62 citations
