Kronecker Generative Networks: A General Neural Architecture for Parameter-Efficient Learning Across Classification Tasks
Yang Yang, Zhengmin Kong, Yuan Liu, Tao Huang, Wei Xiang
Abstract
Modern neural networks derive much of their effectiveness from rich connectivity patterns. Yet, existing architectures often fix the topology at either the sparse or dense extremes, thereby limiting structural flexibility and analysis. We propose Kronecker Generative Networks (KGNs), an algebraic framework that constructs neural network topologies via recursive generation rules, treating topology as a first-class design object. KGNs generate families of directed acyclic graphs with controllable connectivity complexity, enabling systematic interpolation between sparse and dense aggregation regimes. Under this formulation, architectures such as FractalNet and DenseNet arise as specific instantiations corresponding to different generation rules. We provide theoretical analysis of acyclicity, connectivity scaling, and expressiveness, and demonstrate experimentally that KGN instantiations achieve favorable accuracy-efficiency trade-offs across multiple domains.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7576f43e-caf4-454e-8a92-7abd7ddc6694Builds on5
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Rigging the Lottery: Making All Tickets WinnersUtku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro et al.ICML 2020 · 723 citations
- Kronecker Attention NetworksHongyang Gao, Zhengyang Wang, Shuiwang JiKDD 2020 · 35 citations
- FSTA-SNN: Frequency-Based Spatial-Temporal Attention Module for Spiking Neural NetworksKairong Yu, Tianqing Zhang, Hongwei Wang, Qi XuAAAI 2025 · 20 citations
- Spiking Transformer: Introducing Accurate Addition-Only Spiking Self-Attention for TransformerYufei Guo, Xiaode Liu, Yuanpei Chen, Weihang Peng et al.CVPR 2025
Related papers
- AutoShrink: A Topology-Aware NAS for Discovering Efficient Neural ArchitectureTunhou Zhang, Hsin-Pai Cheng, Zhenwen Li, Feng Yan et al.AAAI 2020 · 9 citations
- Optimal Recurrent Network Topologies for Dynamical Systems ReconstructionChristoph Jürgen Hemmer, Manuel Brenner, Florian Hess, Daniel DurstewitzICML 2024 · 6 citations
- Copresheaf Topological Neural Networks: A Generalized Deep Learning FrameworkMustafa Hajij, Lennart Bastian, Sarah Osentoski, Hardik Kabaria et al.NeurIPS 2025 · 15 citations
- Modeling Structure with Undirected Neural NetworksTsvetomila Mihaylova, Vlad Niculae, André F. T. MartinsICML 2022 · 1 citation
- Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained AnalysisWuyang Chen, Wei Huang, Xinyu Gong, Boris Hanin et al.NeurIPS 2022 · 9 citations
