Deep Clustering Based on Sparse Kolmogorov-Arnold Network and Spectral Constraint
Zixuan Bi, Yang Zhao, Ganchao Liu
Abstract
At present, spectral clustering is an important branch of unsupervised learning, and its application in deep learning has been widely concerned. However, for high-dimensional sparse datasets, the complexity of network scale leads to parameter explosion, and static Gaussian kernel often has wrong preset data structure. To overcome these challenges, we propose a novel deep clustering model, Deep Clustering Based on Sparse Kolmogorov-Arnold Network (KAN) and Spectral Constraint. It contains a deep sparse clustering framework, in which sparse KAN and the orthogonal layer are designed to enhance the sparsity of the activation function matrix, reduce the number of parameters and improve the stability of model convergence. Additionally, we add an adaptive optimized affinity matrix based on spectral constraint, which overcomes the limitations of static Gaussian kernels, and improves the performance and stability of spectral constraint. Experimental results on both synthetic and real datasets demonstrate that our model outperforms existing methods in clustering performance, computational efficiency, and stability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 196ab890-51e3-4ffd-9b8f-ec79f36cc647Builds on6
- Revisiting Gradient Clipping: Stochastic bias and tight convergence guaranteesAnastasia Koloskova, Hadrien Hendrikx, Sebastian U. StichICML 2023 · 106 citations
- Data-free Knowledge Distillation for Fine-grained Visual CategorizationRenrong Shao, Wei Zhang, Jianhua Yin, Jun WangICCV 2023 · 7 citations
- Enhancing the Adversarial Robustness via Manifold ProjectionZhiting Li, Shibai Yin, Tai-Xiang Jiang, Yexun Hu et al.AAAI 2025 · 5 citations
- Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial DistillationBo Huang, Mingyang Chen, Yi Wang, Junda Lu et al.CVPR 2023
- Double Low-Rank Representation With Projection Distance Penalty for ClusteringZhiqiang Fu, Yao Zhao, Dongxia Chang, Xingxing Zhang et al.CVPR 2021
Related papers
- Deep Fair Multi-View Clustering with Attention KANHaiming Xu, Qianqian Wang, Boyue Wang, Quanxue GaoCVPR 2025
- Sparse Subspace Clustering with Entropy-NormLiang Bai, Jiye LiangICML 2020 · 39 citations
- Cross-Modal Subspace Clustering via Deep Canonical Correlation AnalysisQuanxue Gao, Huanhuan Lian, Qianqian Wang, Gan SunAAAI 2020 · 65 citations
- Multi-Scale Fusion Subspace Clustering Using Similarity ConstraintZhiyuan Dang, Cheng Deng, Xu Yang, Heng HuangCVPR 2020
- Efficient Deep Embedded Subspace ClusteringJinyu Cai, Jicong Fan, Wenzhong Guo, Shiping Wang et al.CVPR 2022 · 127 citations
