Graph-Smoothed Bayesian Black-Box Shift Estimator and Its Information Geometry
Masanari Kimura
Abstract
Label shift adaptation aims to recover target class priors when the labelled source distribution and the unlabelled target distribution share but . Classical black-box shift estimators invert an empirical confusion matrix of a frozen classifier, producing a brittle point estimate that ignores sampling noise and similarity among classes. We present Graph-Smoothed Bayesian BBSE (GS-BSE), a fully probabilistic alternative that places Laplacian-Gaussian priors on both target log-priors and confusion-matrix columns, tying them together on a label-similarity graph. The resulting posterior is tractable with HMC or a fast block Newton-CG scheme. We prove identifiability, contraction, variance bounds that shrink with the graph's algebraic connectivity, and robustness to Laplacian misspecification. We also reinterpret GS-BSE through information geometry, showing that it generalizes existing shift estimators.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 72659636-49bd-4c2c-9906-7d9bae51eef3Builds on6
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- WILDS: A Benchmark of in-the-Wild Distribution ShiftsPang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie et al.ICML 2021 · 1,773 citations
- A Unified View of Label Shift EstimationSaurabh Garg, Yifan Wu, Sivaraman Balakrishnan, Zachary C. LiptonNeurIPS 2020 · 186 citations
- Mandoline: Model Evaluation under Distribution ShiftMayee F. Chen, Karan Goel, Nimit Sharad Sohoni, Fait Poms et al.ICML 2021 · 84 citations
- RLSbench: Domain Adaptation Under Relaxed Label ShiftSaurabh Garg, Nick Erickson, James Sharpnack, Alex Smola et al.ICML 2023 · 44 citations
Related papers
- Optimizing Black-box Metrics with Iterative Example WeightingGaurush Hiranandani, Jatin Mathur, Harikrishna Narasimhan, Mahdi Milani Fard et al.ICML 2021 · 8 citations
- Maximum Likelihood with Bias-Corrected Calibration is Hard-To-Beat at Label Shift AdaptationAmr Alexandari, Anshul Kundaje, Avanti ShrikumarICML 2020 · 123 citations
- Gradient-Based Sample Selection for Black-Box Universal Domain AdaptationQiuyan He, Minghua DengAAAI 2025
- A Separation and Alignment Framework for Black-Box Domain AdaptationMingxuan Xia, Junbo Zhao, Gengyu Lyu, Zenan Huang et al.AAAI 2024 · 12 citations
- Dangers of Bayesian Model Averaging under Covariate ShiftPavel Izmailov, Patrick Nicholson, Sanae Lotfi, Andrew Gordon WilsonNeurIPS 2021 · 51 citations
