Kronecker Generative Networks: A General Neural Architecture for Parameter-Efficient Learning Across Classification Tasks
Yang Yang, Zhengmin Kong, Yuan Liu, Tao Huang, Wei Xiang
摘要
Modern neural networks derive much of their effectiveness from rich connectivity patterns. Yet, existing architectures often fix the topology at either the sparse or dense extremes, thereby limiting structural flexibility and analysis. We propose Kronecker Generative Networks (KGNs), an algebraic framework that constructs neural network topologies via recursive generation rules, treating topology as a first-class design object. KGNs generate families of directed acyclic graphs with controllable connectivity complexity, enabling systematic interpolation between sparse and dense aggregation regimes. Under this formulation, architectures such as FractalNet and DenseNet arise as specific instantiations corresponding to different generation rules. We provide theoretical analysis of acyclicity, connectivity scaling, and expressiveness, and demonstrate experimentally that KGN instantiations achieve favorable accuracy-efficiency trade-offs across multiple domains.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh 等ICCV 2019 · 被引用 5,843 次
- Rigging the Lottery: Making All Tickets WinnersUtku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro 等ICML 2020 · 被引用 723 次
- Kronecker Attention NetworksHongyang Gao, Zhengyang Wang, Shuiwang JiKDD 2020 · 被引用 35 次
- FSTA-SNN: Frequency-Based Spatial-Temporal Attention Module for Spiking Neural NetworksKairong Yu, Tianqing Zhang, Hongwei Wang, Qi XuAAAI 2025 · 被引用 20 次
- Spiking Transformer: Introducing Accurate Addition-Only Spiking Self-Attention for TransformerYufei Guo, Xiaode Liu, Yuanpei Chen, Weihang Peng 等CVPR 2025
相关 Paper
- AutoShrink: A Topology-Aware NAS for Discovering Efficient Neural ArchitectureTunhou Zhang, Hsin-Pai Cheng, Zhenwen Li, Feng Yan 等AAAI 2020 · 被引用 9 次
- Optimal Recurrent Network Topologies for Dynamical Systems ReconstructionChristoph Jürgen Hemmer, Manuel Brenner, Florian Hess, Daniel DurstewitzICML 2024 · 被引用 6 次
- Copresheaf Topological Neural Networks: A Generalized Deep Learning FrameworkMustafa Hajij, Lennart Bastian, Sarah Osentoski, Hardik Kabaria 等NeurIPS 2025 · 被引用 15 次
- Modeling Structure with Undirected Neural NetworksTsvetomila Mihaylova, Vlad Niculae, André F. T. MartinsICML 2022 · 被引用 1 次
- Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained AnalysisWuyang Chen, Wei Huang, Xinyu Gong, Boris Hanin 等NeurIPS 2022 · 被引用 9 次
