Equivariance Allows Handling Multiple Nuisance Variables When Analyzing Pooled Neuroimaging Datasets
Vishnu Suresh Lokhande, Rudrasis Chakraborty, Sathya N. Ravi, Vikas Singh
Abstract
Pooling multiple neuroimaging datasets across institutions often enables improvements in statistical power when evaluating associations (e.g., between risk factors and disease outcomes) that may otherwise be too weak to detect. When there is only a single source of variability (e.g., different scanners), domain adaptation and matching the distributions of representations may suffice in many scenarios. But in the presence of more than one nuisance variable which concurrently influence the measurements, pooling datasets poses unique challenges, e.g., variations in the data can come from both the acquisition method as well as the demographics of participants (gender, age). Invariant representation learning, by itself, is ill-suited to fully model the data generation process. In this paper, we show how bringing recent results on equivariant representation learning (for studying symmetries in neural networks) instantiated on structured spaces together with simple use of classical results on causal inference provides an effective practical solution. In particular, we demonstrate how our model allows dealing with more than one nuisance variable under some assumptions and can enable analysis of pooled scientific datasets in scenarios that would otherwise entail removing a large portion of the samples. Our code is available on https://github.com/vsingh-group/DatasetPooling.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cbbb2844-73c6-4d00-869a-cb54c801cb6bCited by top-tier papers3
- Pooling Image Datasets with Multiple Covariate Shift and ImbalanceSotirios Panagiotis Chytas, Vishnu Suresh Lokhande, Vikas SinghICLR 2024 · 3 citations
- ManifoldGD: Training-Free Hierarchical Manifold Guidance for Diffusion-Based Dataset DistillationAyush Roy, Wei-Yang Alex Lee, Rudrasis Chakraborty, Vishnu Suresh LokhandeCVPR 2026 · 2 citations
- Forget Less by Learning from Parents Through Hierarchical RelationshipsArjun Ramesh Kaushik, Naresh Kumar Devulapally, Vishnu Suresh Lokhande, Nalini K. Ratha et al.AAAI 2026
Builds on5
- Domain Generalization using Causal MatchingDivyat Mahajan, Shruti Tople, Amit SharmaICML 2021 · 399 citations
- Generalized Source-free Domain AdaptationShiqi Yang, Yaxing Wang, Joost van de Weijer, Luis Herranz et al.ICCV 2021 · 319 citations
- Learning Invariant Representations using Inverse Contrastive LossAditya Kumar Akash, Vishnu Suresh Lokhande, Sathya N. Ravi, Vikas SinghAAAI 2021 · 10 citations
- Scaling Recurrent Models via Orthogonal Approximations in Tensor TrainsRonak Mehta, Rudrasis Chakraborty, Vikas Singh, Yunyang XiongICCV 2019 · 4 citations
- Adaptive Methods for Real-World Domain GeneralizationAbhimanyu Dubey, Vignesh Ramanathan, Alex Pentland, Dhruv MahajanCVPR 2021
Related papers
- Domain Invariant Representation Learning with Domain Density TransformationsA. Tuan Nguyen, Toan Tran, Yarin Gal, Atilim Gunes BaydinNeurIPS 2021 · 121 citations
- Invariant and Transportable Representations for Anti-Causal Domain ShiftsYibo Jiang, Victor VeitchNeurIPS 2022 · 50 citations
- Domain Adaptation with Invariant Representation Learning: What Transformations to Learn?Petar Stojanov, Zijian Li, Mingming Gong, Ruichu Cai et al.NeurIPS 2021 · 70 citations
- A Bit More Bayesian: Domain-Invariant Learning with UncertaintyZehao Xiao, Jiayi Shen, Xiantong Zhen, Ling Shao et al.ICML 2021 · 47 citations
- Learning Robust Hierarchical Patterns of Human Brain across Many fMRI StudiesDushyant Sahoo, Christos DavatzikosNeurIPS 2021 · 4 citations
