Removing Biases from Molecular Representations via Information Maximization
Chenyu Wang, Sharut Gupta, Caroline Uhler, Tommi S. Jaakkola
Abstract
High-throughput drug screening -- using cell imaging or gene expression measurements as readouts of drug effect -- is a critical tool in biotechnology to assess and understand the relationship between the chemical structure and biological activity of a drug. Since large-scale screens have to be divided into multiple experiments, a key difficulty is dealing with batch effects, which can introduce systematic errors and non-biological associations in the data. We propose InfoCORE, an Information maximization approach for COnfounder REmoval, to effectively deal with batch effects and obtain refined molecular representations. InfoCORE establishes a variational lower bound on the conditional mutual information of the latent representations given a batch identifier. It adaptively reweighs samples to equalize their implied batch distribution. Extensive experiments on drug screening data reveal InfoCORE's superior performance in a multitude of tasks including molecular property prediction and molecule-phenotype retrieval. Additionally, we show results for how InfoCORE offers a versatile framework and resolves general distribution shifts and issues of data fairness by minimizing correlation with spurious features or removing sensitive attributes. The code is available at https://github.com/uhlerlab/InfoCORE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 35b66cd0-87de-413b-8a34-5bad254008d3Cited by top-tier papers8
- How Molecules Impact Cells: Unlocking Contrastive PhenoMolecular RetrievalPhilip Fradkin, Puria Azadi Moghadam, Karush Suri, Frederik Wenkel et al.NeurIPS 2024 · 14 citations
- Learning Molecular Representation in a CellGang Liu, Srijit Seal, John Arevalo, Zhenwen Liang et al.ICLR 2025
- An Information Criterion for Controlled Disentanglement of Multimodal DataChenyu Wang, Sharut Gupta, Xinyi Zhang, Sana Tonekaboni et al.ICLR 2025
- Learning Cell-Aware Hierarchical Multi-Modal Representations for Robust Molecular ModelingMengran Li, Zelin Zang, Wenbin Xing, Junzhou Chen et al.AAAI 2026
- BiGMINT: Biologically-guided Hierarchical Multimodal Integration for Modeling Multiple Compound Activities in Drug DiscoveryPushpak Pati, Bo Li, Abbas Rayabat Khan, Tomé Albuquerque et al.CVPR 2026
Builds on18
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Fairness without Demographics through Adversarially Reweighted LearningPreethi Lahoti, Alex Beutel, Jilin Chen, Kang Lee et al.NeurIPS 2020 · 406 citations
- Interpretable and Generalizable Graph Learning via Stochastic Attention MechanismSiqi Miao, Mia Liu, Pan LiICML 2022 · 288 citations
Related papers
- Contrastive Mixture of Posteriors for Counterfactual Inference, Data Integration and FairnessAdam Foster, Árpi Vezér, Craig A. Glastonbury, Páidí Creed et al.ICML 2022 · 7 citations
- Variational Learning of Disentangled RepresentationsYuli Slavutsky, Ozgur Beker, David Blei, Bianca DumitrascuICML 2026 · 1 citation
- Efficient Biological Data Acquisition through Inference Set DesignIhor Neporozhnii, Julien Roy, Emmanuel Bengio, Jason S. HartfordICLR 2025
- Asymmetric Contrastive Objectives for Efficient Phenotypic ScreeningLuke Nightingale, Joseph Tuersley, Scott Warchal, Andrea Cairoli et al.ICML 2026 · 1 citation
- Learning Cross-Domain Representations for Transferable Drug Perturbations on Single-Cell Transcriptional ResponsesHui Liu, Shikai JinAAAI 2025 · 1 citation
