HiFusion: Hierarchical Intra-Spot Alignment and Regional Context Fusion for Spatial Gene Expression Prediction from Histopathology
Ziqiao Weng, Yaoyu Fang, Jiahe Qian, Xinkun Wang, Lee A. Cooper, Weidong Cai, Bo Zhou
摘要
Spatial transcriptomics (ST) bridges gene expression and tissue morphology but faces clinical adoption barriers due to technical complexity and prohibitive costs. While computational methods predict gene expression from H&E-stained whole-slide images (WSIs), existing approaches often fail to capture the intricate biological heterogeneity within spots and are susceptible to morphological noise when integrating contextual information from surrounding tissue. To overcome these limitations, we propose HiFusion, a novel deep learning framework that integrates two complementary components. First, we introduce the Hierarchical Intra-Spot Modeling module that extracts fine-grained morphological representations through multi-resolution sub-patch decomposition, guided by a feature alignment loss to ensure semantic consistency across scales. Concurrently, we present the Context-aware Cross-scale Fusion module, which employs cross-attention to selectively incorporate biologically relevant regional context, thereby enhancing representational capacity. This architecture enables comprehensive modeling of both cellular-level features and tissue microenvironmental cues, which are essential for accurate gene expression prediction. Extensive experiments on two benchmark ST datasets demonstrate that HiFusion achieves state-of-the-art performance across both 2D slide-wise cross-validation and more challenging 3D sample-specific scenarios. These results underscore HiFusion’s potential as a robust, accurate, and scalable solution for ST inference from routine histopathology.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper3
- Spatially Resolved Gene Expression Prediction from Histology Images via Bi-modal Contrastive LearningRonald Xie, Kuan Pang, Sai Chung, Catia Perciani 等NeurIPS 2023 · 被引用 125 次
- Accurate Spatial Gene Expression Prediction by Integrating Multi-Resolution FeaturesYoungmin Chung, Ji Hun Ha, Kyeong Chan Im, Joo Sang LeeCVPR 2024
- ASIGN: An Anatomy-aware Spatial Imputation Graphic Network for 3D Spatial TranscriptomicsJunchao Zhu, Ruining Deng, Tianyuan Yao, Juming Xiong 等CVPR 2025
相关 Paper
- HyperST: Hierarchical Hyperbolic Learning for Spatial Transcriptomics PredictionChen Zhang, Yilu An, Ying Chen, Hao Li 等CVPR 2026
- Predicting Spatial Transcriptomics from Histology Images via High-Order Multi-Cell Interaction ModelingYouhan Sun, Jiahua Rao, Kangrui Du, Jiancong Xie 等CVPR 2026
- HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics ModelingWeiyi Wu, Xinwen Xu, Xingjian Diao, Siting Li 等ICML 2026
- From Spots to Pixels: Dense Spatial Gene Expression Prediction from Histology ImagesRuikun Zhang, Yan Yang, Liyuan PanCVPR 2026 · 被引用 2 次
- Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology ImagesSichen Zhu, Yuchen Zhu, Molei Tao, Peng QiuICLR 2025
