Distribution-dependent McDiarmid-type Inequalities for Functions of Unbounded Interaction
Shaojie Li, Yong Liu
Abstract
The concentration of measure inequalities serves an essential role in statistics and machine learning. This paper gives unbounded analogues of the McDiarmid-type exponential inequalities for three popular classes of distributions, namely sub-Gaussian, sub-exponential and heavy-tailed distributions. The inequalities in the sub-Gaussian and sub-exponential cases are distribution-dependent compared with the recent results, and the inequalities in the heavy-tailed case are not available in the previous works. The usefulness of the inequalities is illustrated through applications to the sample mean, U-statistics and V-statistics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a98c9da2-3848-48ee-9cc5-ea153455eebeCited by top-tier papers1
Ask how each one uses itBuilds on6
- The Heavy-Tail Phenomenon in SGDMert Gürbüzbalaban, Umut Simsekli, Lingjiong ZhuICML 2021 · 165 citations
- Heavy Tails in SGD and Compressibility of Overparametrized Neural NetworksMelih Barsbey, Milad Sefidgaran, Murat A. Erdogdu, Gaël Richard et al.NeurIPS 2021 · 57 citations
- Accountable Off-Policy Evaluation With Kernel Bellman StatisticsYihao Feng, Tongzheng Ren, Ziyang Tang, Qiang LiuICML 2020 · 45 citations
- Concentration inequalities under sub-Gaussian and sub-exponential conditionsAndreas Maurer, Massimiliano PontilNeurIPS 2021 · 39 citations
- Relative Deviation Margin BoundsCorinna Cortes, Mehryar Mohri, Ananda Theertha SureshICML 2021 · 16 citations
Related papers
- Concentration Inequalities for General Functions of Heavy-Tailed Random VariablesShaojie Li, Yong LiuICML 2024 · 1 citation
- Parameter-free Regret in High Probability with Heavy TailsJiujia Zhang, Ashok CutkoskyNeurIPS 2022 · 41 citations
- Algorithmic Stability Unleashed: Generalization Bounds with Unbounded LossesShaojie Li, Bowei Zhu, Yong LiuICML 2024 · 3 citations
- Towards Understanding Generalization of Macro-AUC in Multi-label LearningGuoqiang Wu, Chongxuan Li, Yilong YinICML 2023 · 9 citations
- Uniform Mean Estimation for Heavy-Tailed Distributions via Median-of-MeansMikael Møller Høgsgaard, Andrea PaudiceICML 2025
