Sample Weighted Incomplete Multimodal Clustering Based on Graph Coarsening Label Extraction
Zhenjiao Liu, Xue Xiao, Yao Chen, Jiao Xue, Shubin Ma, Liang Zhao
Abstract
Multimodal data is typically collected through heterogeneous sensors and processing pipelines. However, due to variations in acquisition environments, device capabilities, and feature extraction methods, such data often suffers from incompleteness and inconsistent quality across modalities. To address these challenges, prior studies have explored modality selection and data completion strategies to improve information fusion. Nevertheless, these approaches face two main limitations: (1) they struggle to simultaneously ensure computational efficiency for large-scale graph data and maintain structural and semantic consistency across heterogeneous modality graphs; and (2) most of them operate at the modality level and fail to capture fine-grained, sample-specific quality variations.
To overcome these issues, we propose a novel clustering framework, Sample Weighted Incomplete Multimodal Clustering Based on Graph Coarsening Label Extraction (IMC-GCSW). The proposed method introduces a graph coarsening-based label extraction strategy. It significantly reduces the computational cost of multimodal graph processing, while preserving key node information and local topological structures. Furthermore, a quality-aware sample weighting strategy is designed to enable fine-grained modeling of modality-specific data quality, allowing the model to dynamically suppress the influence of low-quality modalities on individual samples. Experiments on both general-purpose datasets and the Fructus Aurantii Disease and Pest Datasets demonstrate that the proposed method exhibits superior performance and strong adaptability in handling multimodal data with incompleteness and quality inconsistency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Heterogeneous Graph Structure Learning for Graph Neural NetworksJianan Zhao, Xiao Wang, Chuan Shi, Binbin Hu et al.AAAI 2021 · 306 citations
- Deep Incomplete Multi-View Clustering via Mining Cluster ComplementarityJie Xu, Chao Li, Yazhou Ren, Liang Peng et al.AAAI 2022 · 149 citations
- Incomplete Contrastive Multi-View Clustering with High-Confidence GuidingGuoqing Chao, Yi Jiang, Dianhui ChuAAAI 2024 · 135 citations
- Adaptive Feature Imputation with Latent Graph for Deep Incomplete Multi-View ClusteringJingyu Pu, Chenhang Cui, Xinyue Chen, Yazhou Ren et al.AAAI 2024 · 46 citations
- Deep Variational Incomplete Multi-View Clustering: Exploring Shared Clustering StructuresGehui Xu, Jie Wen, Chengliang Liu, Bing Hu et al.AAAI 2024 · 44 citations
Related papers
- HGMF: Heterogeneous Graph-based Fusion for Multimodal Data with IncompletenessJiayi Chen, Aidong ZhangKDD 2020 · 89 citations
- Incomplete and Unpaired Multi-View Graph Clustering with Cross-View Feature FusionLiang Zhao, Ziyue Wang, Xiao Wang, Zhikui Chen et al.AAAI 2025 · 6 citations
- Scalable Incomplete Multi-View Clustering with Structure AlignmentYi Wen, Siwei Wang, Ke Liang, Weixuan Liang et al.ACM MM 2023 · 36 citations
- Fast and Scalable Incomplete Multi-View Clustering with Duality Optimal Graph FilteringLiang Du, Yukai Shi, Yan Chen, Peng Zhou et al.ACM MM 2024 · 18 citations
- A Consensus Anchor-guided Hypergraph Framework for Incomplete Multi-view ClusteringYipin Hu, Yanxi Liu, Fangxi Liu, Yanwei Yu et al.ICML 2026
