Adjust Pearson's to Measure Arbitrary Monotone Dependence
Xinbo Ai
摘要
Pearson's r, the most widely-used correlation coefficient, is traditionally regarded as exclusively capturing linear dependence, leading to its discouragement in contexts involving nonlinear relationships. However, recent research challenges this notion, suggesting that Pearson's r should not be ruled out a priori for measuring nonlinear monotone relationships. Pearson's r is essentially a scaled covariance, rooted in the renowned Cauchy-Schwarz Inequality. Our findings reveal that different scaling bounds yield coefficients with different capture ranges, and interestingly, tighter bounds actually expand these ranges. We derive a tighter inequality than Cauchy-Schwarz Inequality, leverage it to refine Pearson's r, and propose a new correlation coefficient, i.e., rearrangement correlation. This coefficient is able to capture arbitrary monotone relationships, both linear and nonlinear ones. It reverts to Pearson's r in linear scenarios. Simulation experiments and real-life investigations show that the rearrangement correlation is more accurate in measuring nonlinear monotone dependence than the three classical correlation coefficients, and other recently proposed dependence measures.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
相关 Paper
- SHGR: A Generalized Maximal Correlation CoefficientSamuel Stocksieker, Denys PommeretNeurIPS 2025
- Systematically Exploring Associations among Multivariate DataLifeng ZhangAAAI 2020 · 被引用 5 次
- Absolute Neighbour Difference based Correlation Test for Detecting Heteroscedastic RelationshipsLifeng ZhangNeurIPS 2021 · 被引用 1 次
- Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical DependenceAlexander Semenenko, Ivan Butakov, Ivan Oseledets, Alexey FrolovICLR 2026 · 被引用 1 次
- Multi-Level Wavelet Mapping Correlation for Statistical Dependence Measurement: Methodology and PerformanceYixin Ren, Hao Zhang, Yewei Xia, Jihong Guan 等AAAI 2023 · 被引用 4 次
