Kernel-based Maximum-of-difference Test for Two-sample Comparison
Dan Pu, Tianyi Zhu, Yao Yan, Wei Lan
Abstract
Two-sample comparison is a fundamental problem in machine learning, with broad applications such as generative modeling. Although the maximum mean discrepancy (MMD) is widely used, MMD-based tests often exhibit poor or even counterintuitive performance under covariance- and location-shift alternatives, partly due to cancellation effects induced by their sum-of-differences construction. To address this issue, we propose a kernel-based maximum-of-difference (MOD) test, which maximizes the squared discrepancy between within-sample and between-sample average distances, thereby improving sensitivity to subtle distributional differences. We further develop a fused MOD procedure to adaptively combine multiple kernels. Extensive experiments demonstrate clear performance gains over existing MMD-based methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on4
- Learning Deep Kernels for Non-Parametric Two-Sample TestsFeng Liu, Wenkai Xu, Jie Lu, Guangquan Zhang et al.ICML 2020 · 213 citations
- MMD-Fuse: Learning and Combining Kernels for Two-Sample Testing Without Data SplittingFelix Biggs, Antonin Schrab, Arthur GrettonNeurIPS 2023 · 49 citations
- A permutation-free kernel two-sample testShubhanshu Shekhar, Ilmun Kim, Aaditya RamdasNeurIPS 2022 · 40 citations
- Meta Two-Sample Testing: Learning Kernels for Testing with Limited DataFeng Liu, Wenkai Xu, Jie Lu, Danica J. SutherlandNeurIPS 2021 · 30 citations
Related papers
- Are Two Datasets Close Enough With Statistical Significance? A Kernel Distributional Closeness Testing ApproachZhijian Zhou, Liuhua Peng, Xunye Tian, Mingming Gong et al.ICML 2026 · 1 citation
- Maximum Mean Discrepancy Test is Aware of Adversarial AttacksRuize Gao, Feng Liu, Jingfeng Zhang, Bo Han et al.ICML 2021 · 77 citations
- Neural Tangent Kernel Maximum Mean DiscrepancyXiuyuan Cheng, Yao XieNeurIPS 2021 · 26 citations
- DUAL: Learning Diverse Kernels for Aggregated Two-sample and Independence TestingZhijian Zhou, Xunye Tian, Liuhua Peng, Chao Lei et al.NeurIPS 2025 · 8 citations
- An Asymptotic Test for Conditional Independence using Analytic Kernel EmbeddingsMeyer Scetbon, Laurent Meunier, Yaniv RomanoICML 2022 · 18 citations
