Predicting Spatial Transcriptomics from Histology Images via High-Order Multi-Cell Interaction Modeling
Youhan Sun, Jiahua Rao, Kangrui Du, Jiancong Xie, Yuedong Yang
摘要
Spatial transcriptomics (ST) links gene expression to tissue architecture and enables predicting spatial expression from H&E-stained whole-slide images (WSIs). However, existing spot-or slide-level predictors focus on single-spot features or pairwise relations, failing to capture high-order, manyto-many cross-cell interactions. As a result, they miss synergistic and antagonistic effects among multiple neighboring cells. Here, we introduce MCToGene, a scalable and accurate framework that explicitly models multi-cell interactions via many-body attention with hierarchical coupling to predict spatial gene expression. MCToGene employs a many-body attention module to encode high-order, manyto-many cross-cell dependencies, enabling context-aware microenvironment modeling. To mitigate the combinatorial burden of many-body modeling, we design a hierarchical interaction module that couples pairwise and many-body representations for feature aggregation and prediction, preserving many-body expressiveness while controlling computation and memory. On HEST-1k and STImage-1K4M, MCToGene surpasses state-of-the-art baselines with 7.85% relative improvement. Ablations confirm that explicit highorder, many-to-many modeling drives these gains, and visualizations demonstrate that multi-cell interactions are essential for biologically coherent spatial predictions.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Spatially Resolved Gene Expression Prediction from Histology Images via Bi-modal Contrastive LearningRonald Xie, Kuan Pang, Sai Chung, Catia Perciani 等NeurIPS 2023 · 被引用 125 次
- MedM2G: Unifying Medical Multi-Modal Generation via Cross-Guided Diffusion with Visual InvariantChenlu Zhan, Yu Lin, Gaoang Wang, Hongwei Wang 等CVPR 2024 · 被引用 20 次
- Diffusion Models for Multi-Task Generative ModelingChangyou Chen, Han Ding, Bunyamin Sisman, Yi Xu 等ICLR 2024 · 被引用 11 次
相关 Paper
- HiFusion: Hierarchical Intra-Spot Alignment and Regional Context Fusion for Spatial Gene Expression Prediction from HistopathologyZiqiao Weng, Yaoyu Fang, Jiahe Qian, Xinkun Wang 等AAAI 2026
- Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow MatchingTinglin Huang, Tianyu Liu, Mehrtash Babadi, Wengong Jin 等ICML 2025
- M2OST: Many-to-one Regression for Predicting Spatial Transcriptomics from Digital Pathology ImagesHongyi Wang, Xiuju Du, Jing Liu, Shuyi Ouyang 等AAAI 2025 · 被引用 12 次
- SPATIA: Multimodal Generation and Prediction of Spatial Cell PhenotypesZhenglun Kong, Mufan Qiu, John Boesen, xiang lin 等ICML 2026 · 被引用 1 次
- FEAST: Fully Connected Expressive Attention for Spatial TranscriptomicsTaejin Jeong, Joohyeok Kim, Jinyeong Kim, Chanyoung Kim 等CVPR 2026 · 被引用 1 次
