Emergent Visual Representations through Unsupervised Spiking Networks with Synaptic Pruning
Di Hong, Dazhong Rong, Yueming Wang
Abstract
Recent work has shown that brain-aligned visual representations can emerge even in randomly initialized, high-dimensional neural networks, suggesting that cortical representations may be discovered rather than fully learned through task optimization. However, how such latent brain-relevant representations are stabilized and refined during development remains unclear. Motivated by this perspective and by neuroscientific evidence of activity-dependent synaptic pruning, we study how brain-aligned representations can emerge and be refined from high-dimensional unsupervised spiking systems. We propose a biologically grounded deep SNN that integrates unsupervised learning with developmental pruning dynamics. Starting from an overcomplete spiking architecture, the model self-organizes through sensory-driven activity while selectively eliminating weak or redundant synapses, progressively yielding compact and informative representations. Without using labels, the resulting network forms hierarchical visual representations that strongly align with neural responses across multiple areas of the mouse and macaque visual cortex, outperforming supervised and unsupervised ANN and SNN baselines. Synaptic pruning further improves alignment and robustness under noisy and few-shot recognition settings. By unifying high-dimensional unsupervised spiking representations with activity-dependent synaptic pruning, this work provides a computational account of developmental refinement in visual cortex and bridges recent findings on emergent brain alignment in random networks with biologically grounded models of representation learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9f5d01cb-ff68-46b5-9c0d-fd5eb6b5d6bfBuilds on3
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Deep Residual Learning in Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Tiejun Huang et al.NeurIPS 2021 · 857 citations
- Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and MouseLiwei Huang, Zhengyu Ma, Liutao Yu, Huihui Zhou et al.AAAI 2023 · 15 citations
Related papers
- Reversing Structural Pattern Learning with Biologically Inspired Knowledge Distillation for Spiking Neural NetworksQi Xu, Yaxin Li, Xuanye Fang, Jiangrong Shen et al.ACM MM 2024 · 12 citations
- ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural NetworksJiangrong Shen, Qi Xu, Jian K. Liu, Yueming Wang et al.AAAI 2023 · 64 citations
- Emergent Orientation Maps - - Mechanisms, Coding Efficiency and RobustnessHaixin Zhong, Haoyu Wang, Wei P. Dai, Yuchao Huang et al.ICLR 2025
- Wiring Up Vision: Minimizing Supervised Synaptic Updates Needed to Produce a Primate Ventral StreamFranziska Geiger, Martin Schrimpf, Tiago Marques, James J. DiCarloICLR 2022 · 14 citations
- Nonlinear dynamics of localization in neural receptive fieldsLeon Lufkin, Andrew M. Saxe, Erin GrantNeurIPS 2024 · 2 citations
