Deep Clustering Based on Sparse Kolmogorov-Arnold Network and Spectral Constraint
Zixuan Bi, Yang Zhao, Ganchao Liu
摘要
At present, spectral clustering is an important branch of unsupervised learning, and its application in deep learning has been widely concerned. However, for high-dimensional sparse datasets, the complexity of network scale leads to parameter explosion, and static Gaussian kernel often has wrong preset data structure. To overcome these challenges, we propose a novel deep clustering model, Deep Clustering Based on Sparse Kolmogorov-Arnold Network (KAN) and Spectral Constraint. It contains a deep sparse clustering framework, in which sparse KAN and the orthogonal layer are designed to enhance the sparsity of the activation function matrix, reduce the number of parameters and improve the stability of model convergence. Additionally, we add an adaptive optimized affinity matrix based on spectral constraint, which overcomes the limitations of static Gaussian kernels, and improves the performance and stability of spectral constraint. Experimental results on both synthetic and real datasets demonstrate that our model outperforms existing methods in clustering performance, computational efficiency, and stability.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- Revisiting Gradient Clipping: Stochastic bias and tight convergence guaranteesAnastasia Koloskova, Hadrien Hendrikx, Sebastian U. StichICML 2023 · 被引用 106 次
- Data-free Knowledge Distillation for Fine-grained Visual CategorizationRenrong Shao, Wei Zhang, Jianhua Yin, Jun WangICCV 2023 · 被引用 7 次
- Enhancing the Adversarial Robustness via Manifold ProjectionZhiting Li, Shibai Yin, Tai-Xiang Jiang, Yexun Hu 等AAAI 2025 · 被引用 5 次
- Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial DistillationBo Huang, Mingyang Chen, Yi Wang, Junda Lu 等CVPR 2023
- Double Low-Rank Representation With Projection Distance Penalty for ClusteringZhiqiang Fu, Yao Zhao, Dongxia Chang, Xingxing Zhang 等CVPR 2021
相关 Paper
- Deep Fair Multi-View Clustering with Attention KANHaiming Xu, Qianqian Wang, Boyue Wang, Quanxue GaoCVPR 2025
- Sparse Subspace Clustering with Entropy-NormLiang Bai, Jiye LiangICML 2020 · 被引用 39 次
- Cross-Modal Subspace Clustering via Deep Canonical Correlation AnalysisQuanxue Gao, Huanhuan Lian, Qianqian Wang, Gan SunAAAI 2020 · 被引用 65 次
- Multi-Scale Fusion Subspace Clustering Using Similarity ConstraintZhiyuan Dang, Cheng Deng, Xu Yang, Heng HuangCVPR 2020
- Efficient Deep Embedded Subspace ClusteringJinyu Cai, Jicong Fan, Wenzhong Guo, Shiping Wang 等CVPR 2022 · 被引用 127 次
