Improving Representation Learning for Histopathologic Images with Cluster Constraints
Weiyi Wu, Chongyang Gao, Joseph DiPalma, Soroush Vosoughi, Saeed Hassanpour
Abstract
Recent advances in whole-slide image (WSI) scanners and computational capabilities have significantly propelled the application of artificial intelligence in histopathology slide analysis. While these strides are promising, current supervised learning approaches for WSI analysis come with the challenge of exhaustively labeling high-resolution slides-a process that is both labor-intensive and timeconsuming. In contrast, self-supervised learning (SSL) pretraining strategies are emerging as a viable alternative, given that they don't rely on explicit data annotations. These SSL strategies are quickly bridging the performance disparity with their supervised counterparts. In this context, we introduce an SSL framework. This framework aims for transferable representation learning and semantically meaningful clustering by synergizing invariance loss and clustering loss in WSI analysis. Notably, our approach outperforms common SSL methods in downstream classification and clustering tasks, as evidenced by tests on the Camelyon16 and a pancreatic cancer dataset. The code and additional details are accessible at: https: //github.com/wwyi1828/CluSiam .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- GMMamba: Group Masking Mamba for Whole Slide Image ClassificationTingting Zheng, Hongxun Yao, Kui Jiang, Yi Xiao et al.ICCV 2025 · 5 citations
- Cancer Survival Analysis via Zero-shot Tumor Microenvironment Segmentation on Low-resolution Whole Slide Pathology ImagesJiao Tang, Wei Shao, Daoqiang ZhangNeurIPS 2025 · 2 citations
- SGCD: Stain-Guided CycleDiffusion for Unsupervised Domain Adaptation of Histopathology Image ClassificationHsi-Ling Chen, Chun-Shien Lu, Pau-Choo ChungNeurIPS 2025 · 1 citation
- HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics ModelingWeiyi Wu, Xinwen Xu, Xingjian Diao, Siting Li et al.ICML 2026
- Tumor Micro-Environment Interactions Guided Graph Learning for Survival Analysis of Human Cancers from Whole-Slide Pathological ImagesWei Shao, Yangyang Shi, Daoqiang Zhang, Junjie Zhou et al.CVPR 2024
Builds on14
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun et al.ICML 2021 · 2,942 citations
- VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised LearningAdrien Bardes, Jean Ponce, Yann LeCunICLR 2022 · 1,226 citations
Related papers
- Dual-Stream Multiple Instance Learning Network for Whole Slide Image Classification With Self-Supervised Contrastive LearningBin Li, Yin Li, Kevin W. EliceiriCVPR 2021
- Unsupervised Foundation Model-Agnostic Slide-Level Representation LearningTim Lenz, Peter Neidlinger, Marta Ligero, Georg Wölflein et al.CVPR 2025
- Benchmarking Self-Supervised Learning on Diverse Pathology DatasetsMingu Kang, Heon Song, Seonwook Park, Donggeun Yoo et al.CVPR 2023
- SCL-WC: Cross-Slide Contrastive Learning for Weakly-Supervised Whole-Slide Image ClassificationXiyue Wang, Jinxi Xiang, Jun Zhang, Sen Yang et al.NeurIPS 2022 · 60 citations
- Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image AnalysisYankai Jiang, Mingze Sun, Heng Guo, Xiaoyu Bai et al.ICCV 2023 · 38 citations
