Cell-Type Prototype-Informed Neural Network for Gene Expression Estimation from Pathology Images
Kazuya Nishimura, Ryoma Bise, Shinnosuke Matsuo, Haruka Hirose, Yasuhiro Kojima
Abstract
Estimating slide-and patch-level gene expression profiles from pathology images enables rapid and low-cost molecular analysis with broad clinical impact. Despite strong results, existing approaches treat gene expression as a mere slide-or spot-level signal and do not incorporate the fact that the measured expression arises from the aggregation of underlying cell-level expression. To explicitly introduce this missing cell-resolved guidance, we propose a Cell-type Prototype-informed Neural Network (CPNN) that leverages publicly available single-cell RNAsequencing datasets. Since single-cell measurements are noisy and not paired with histology images, we first estimate cell-type prototypes-mean expression profiles that capture stable gene-gene co-variation patterns. CPNN then learns cell-type compositional weights directly from images and models the relationship between prototypes and observed bulk or spatial expression, providing a biologically grounded and structurally regularized prediction framework. We evaluate CPNN on three slide-level datasets and three patch-level spatial transcriptomics datasets. Across all settings, CPNN achieves the highest performance in terms of Spearman correlation. Moreover, by visualizing the inferred compositional weights, our framework provides interpretable insights into which cell types drive the predicted expression. Code is publicly available at https: //github.com/naivete5656/CPNN .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Spatially Resolved Gene Expression Prediction from Histology Images via Bi-modal Contrastive LearningRonald Xie, Kuan Pang, Sai Chung, Catia Perciani et al.NeurIPS 2023 · 125 citations
- Improved Baselines with Visual Instruction TuningHaotian Liu, Chunyuan Li, Yuheng Li, Yong Jae LeeCVPR 2024
- MERGE: Multi-faceted Hierarchical Graph-based GNN for Gene Expression Prediction from Whole Slide Histopathology ImagesAniruddha Ganguly, Debolina Chatterjee, Wentao Huang, Jie Zhang et al.CVPR 2025
- Accurate Spatial Gene Expression Prediction by Integrating Multi-Resolution FeaturesYoungmin Chung, Ji Hun Ha, Kyeong Chan Im, Joo Sang LeeCVPR 2024
- Exploring Low-Rank Property in Multiple Instance Learning for Whole Slide Image ClassificationJinxi Xiang, Jun ZhangICLR 2023
Related papers
- From Spots to Pixels: Dense Spatial Gene Expression Prediction from Histology ImagesRuikun Zhang, Yan Yang, Liyuan PanCVPR 2026 · 2 citations
- SpotDiff: Spatial Gene Expression Imputation Diffusion with Single-Cell RNA Sequencing Data IntegrationTianyi Chen, Yunfei Zhang, Lianxin Xie, Wenjun Shen et al.AAAI 2025 · 2 citations
- HistoPrism: Unlocking Functional Pathway Analysis from Pan-Cancer Histology via Gene Expression PredictionSusu Hu, Qinghe Zeng, Nithya Bhasker, Jakob Nikolas Kather et al.ICLR 2026 · 5 citations
- HiFusion: Hierarchical Intra-Spot Alignment and Regional Context Fusion for Spatial Gene Expression Prediction from HistopathologyZiqiao Weng, Yaoyu Fang, Jiahe Qian, Xinkun Wang et al.AAAI 2026
- HEXST: Hexagonal Shifted-Window Transformer for Spatial Transcriptomics Gene Expression PredictionKeunho Byeon, Jin Tae KwakICML 2026 · 1 citation
