Rescuing neural spike train models from bad MLE
Diego M. Arribas, Yuan Zhao, Il Memming Park
Abstract
The standard approach to fitting an autoregressive spike train model is to maximize the likelihood for one-step prediction. This maximum likelihood estimation (MLE) often leads to models that perform poorly when generating samples recursively for more than one time step. Moreover, the generated spike trains can fail to capture important features of the data and even show diverging firing rates. To alleviate this, we propose to directly minimize the divergence between neural recorded and model generated spike trains using spike train kernels. We develop a method that stochastically optimizes the maximum mean discrepancy induced by the kernel. Experiments performed on both real and synthetic neural data validate the proposed approach, showing that it leads to well-behaving models. Using different combinations of spike train kernels, we show that we can control the trade-off between different features which is critical for dealing with model-mismatch.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 307cd151-c9d3-42f7-883f-503992c8a179Cited by top-tier papers4
- Fully Spiking Variational AutoencoderHiromichi Kamata, Yusuke Mukuta, Tatsuya HaradaAAAI 2022 · 54 citations
- Integrating Multimodal Data for Joint Generative Modeling of Complex DynamicsManuel Brenner, Florian Hess, Georgia Koppe, Daniel DurstewitzICML 2024 · 18 citations
- Fitting summary statistics of neural data with a differentiable spiking network simulatorGuillaume Bellec, Shuqi Wang, Alireza Modirshanechi, Johanni Brea et al.NeurIPS 2021 · 13 citations
- Temporal Conditioning Spiking Latent Variable Models of the Neural Response to Natural Visual ScenesGehua Ma, Runhao Jiang, Rui Yan, Huajin TangNeurIPS 2023 · 8 citations
Related papers
- SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with BacktrackingChris Cundy, Stefano ErmonICLR 2024 · 17 citations
- Spike Distance Function as a Learning Objective for Spike PredictionKevin Doran, Marvin Seifert, Carola A. M. Yovanovich, Tom BadenICML 2024 · 1 citation
- Neural Spatio-Temporal Point ProcessesRicky T. Q. Chen, Brandon Amos, Maximilian NickelICLR 2021 · 21 citations
- Exact Gradients for Stochastic Spiking Neural Networks Driven by Rough SignalsChristian Holberg, Cristopher SalviNeurIPS 2024 · 14 citations
- Generative Particle Variational Inference via Estimation of Functional GradientsNeale Ratzlaff, Qinxun Bai, Fuxin Li, Wei XuICML 2021
