Sequential Kernel-based Conditional Independence Testing via Adaptive Betting
Zheng He, Danica J Sutherland
Abstract
Testing conditional independence is fundamental yet intrinsically difficult: without additional assumptions, Type I error control is impossible in general. The ``Model-X'' paradigm addresses this difficulty by assuming exact knowledge of a relevant conditional distribution. While small deviations from this assumption can sometimes be tolerated in classical one-shot testing, existing sequential conditional independence tests typically require the Model-X conditional to be known exactly, making them fragile when it must instead be estimated. We propose a new approach that is substantially more robust to such estimation error. Our method applies testing-by-betting to an adaptively optimized Kernel Conditional Independence statistic, together with a normalization scheme and a truncate-and-shift calibration strategy. These modifications greatly reduce Type I error inflation while preserving high power across high-dimensional synthetic benchmarks and real-world fairness tasks, outperforming existing sequential Model-X approaches. Code is available at https://github.com/he-zh/SKCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Optimal Rates for Regularized Conditional Mean Embedding LearningZhu Li, Dimitri Meunier, Mattes Mollenhauer, Arthur GrettonNeurIPS 2022 · 69 citations
- Invariant and Transportable Representations for Anti-Causal Domain ShiftsYibo Jiang, Victor VeitchNeurIPS 2022 · 50 citations
- Sequential Kernelized Independence TestingAleksandr Podkopaev, Patrick Blöbaum, Shiva Prasad Kasiviswanathan, Aaditya RamdasICML 2023 · 25 citations
- On the Hardness of Conditional Independence Testing In PracticeZheng He, Roman Pogodin, Yazhe Li, Namrata Deka et al.NeurIPS 2025 · 9 citations
- Conditional independence testing under misspecified inductive biasesFelipe Maia Polo, Yuekai Sun, Moulinath BanerjeeNeurIPS 2023 · 8 citations
Related papers
- Practical Kernel Selection for Kernel-based Conditional Independence TestWenjie Wang, Mingming Gong, Biwei Huang, James Bailey et al.NeurIPS 2025 · 2 citations
- Sequential Predictive Two-Sample and Independence TestingAleksandr Podkopaev, Aaditya RamdasNeurIPS 2023 · 29 citations
- Auditing Fairness by BettingBen Chugg, Santiago Cortes-Gomez, Bryan Wilder, Aaditya RamdasNeurIPS 2023 · 29 citations
- Semi-knockoffs: a model-agnostic conditional independence testing method with finite-sample guaranteesAngel REYERO LOBO, Thirion Bertrand, Pierre NeuvialICML 2026
- K-Nearest-Neighbor Local Sampling Based Conditional Independence TestingShuai Li, Yingjie Zhang, Hongtu Zhu, Christina Dan Wang et al.NeurIPS 2023 · 15 citations
