Cross-Slice Knowledge Transfer via Masked Multi-Modal Heterogeneous Graph Contrastive Learning for Spatial Gene Expression Inference
Zhiceng Shi, Changmiao Wang, Jun Wan, Wenwen Min
摘要
While spatial transcriptomics (ST) has advanced understanding of gene expression within tissue context, its high experimental cost limits large-scale application. Predicting ST from pathology images offers a promising, cost-effective alternative, yet existing methods often struggle to capture the complex spatial relationships across slides. To address the challenge, we propose SpaHGC, a multi-modal heterogeneous graph-based model that captures both intra-slice and inter-slice spot-spot relationships from histology images. It integrates local spatial context within the target slide and cross-slide similarities computed from image embeddings extracted by a pathology foundation model. These embeddings enable inter-slice knowledge transfer across slides. Additionally, SpaHGC incorporates Masked Graph Contrastive Learning to enhance feature representation and transfer spatial gene expression knowledge from reference to target slides, enabling it to model complex spatial dependencies and significantly improve prediction accuracy. We conducted comprehensive benchmarking on seven matched histology-ST datasets from different platforms, tissues, and cancer subtypes. The results demonstrate that SpaHGC significantly outperforms the existing nine state-of-the-art methods across all evaluation metrics. Moreover, the model’s predicted ST profiles closely align with the ground truth data and accurately correspond to tumor regions. Additionally, the predictions are significantly enriched in multiple cancer-related pathways, thereby highlighting its strong biological relevance and application potential. Code availability and reproducibility details are in the Supplementary Materials.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa 等ICML 2021 · 被引用 8,974 次
- Spatially Resolved Gene Expression Prediction from Histology Images via Bi-modal Contrastive LearningRonald Xie, Kuan Pang, Sai Chung, Catia Perciani 等NeurIPS 2023 · 被引用 125 次
- PRAGA: Prototype-aware Graph Adaptive Aggregation for Spatial Multi-modal Omics AnalysisXinlei Huang, Zhiqi Ma, Dian Meng, Yanran Liu 等AAAI 2025 · 被引用 24 次
相关 Paper
- Dual-Path Knowledge-Augmented Contrastive Alignment Network for Spatially Resolved TranscriptomicsWei Zhang, Jiajun Chu, Xinci Liu, Chen Tong 等AAAI 2026 · 被引用 1 次
- Multi-modal Topology-embedded Graph Learning for Spatially Resolved Genes Prediction from Pathology Images with Prior Gene Similarity InformationHang Shi, Changxi Chi, Peng Wan, Daoqiang Zhang 等CVPR 2025
- HyperST: Hierarchical Hyperbolic Learning for Spatial Transcriptomics PredictionChen Zhang, Yilu An, Ying Chen, Hao Li 等CVPR 2026
- Heterogeneous Graph Guided Contrastive Learning for Spatially Resolved Transcriptomics DataXiao He, Chang Tang, Xinwang Liu, Chuankun Li 等ACM MM 2024 · 被引用 9 次
- HiFusion: Hierarchical Intra-Spot Alignment and Regional Context Fusion for Spatial Gene Expression Prediction from HistopathologyZiqiao Weng, Yaoyu Fang, Jiahe Qian, Xinkun Wang 等AAAI 2026
