Optimal Estimator for Unlabeled Linear Regression
Hang Zhang, Ping Li
Abstract
Unlabeled linear regression, or "linear regression with an unknown permutation", has attracted increasing attentions due to its applications in (e.g.,) linkage record and de-anonymization. However, the computation of unlabeled linear regression proves to be cumbersome and existing algorithms typically require considerable time, especially in the high dimensional regime. In this paper, we propose a one-step estimator which is optimal from both the computational and the statistical aspects. From the computational perspective, our estimator exhibits the same order of computational complexity as that of the oracle case (which means the regression coefficients are known in advance and only the permutation needs recovery). From the statistical perspective, when comparing with the necessary conditions for permutation recovery, our requirement on the signal-to-noise ratio (SNR) agrees up to merely Ω (log log n) difference when the stable rank of the regression coefficients B is much less than log n/ log log n. Numerical experiments are also provided to corroborate the theoretical claims.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0fbe5d02-bb23-4eda-b161-cc4a979fdd71Cited by top-tier papers4
- Homomorphic Sensing: Sparsity and NoiseLiangzu Peng, Boshi Wang, Manolis C. TsakirisICML 2021 · 19 citations
- A Hypergradient Approach to Robust Regression without CorrespondenceYujia Xie, Yixiu Mao, Simiao Zuo, Hongteng Xu et al.ICLR 2021 · 16 citations
- Smooth Flipping Probability for Differential Private Sign Random Projection MethodsPing Li, Xiaoyun LiNeurIPS 2023 · 7 citations
- Regression with Label Permutation in Generalized Linear ModelGuanhua Fang, Ping LiICML 2023 · 6 citations
Related papers
- One-Step Estimator for Permuted Sparse RecoveryHang Zhang, Ping LiICML 2023 · 6 citations
- Sparse Mixed Linear Regression with Guarantees: Taming an Intractable Problem with Invex RelaxationAdarsh Barik, Jean HonorioICML 2022 · 8 citations
- Label Ranking through Nonparametric RegressionDimitris Fotakis, Alkis Kalavasis, Eleni PsaroudakiICML 2022 · 4 citations
- Unlabeled Principal Component AnalysisYunzhen Yao, Liangzu Peng, Manolis C. TsakirisNeurIPS 2021 · 15 citations
- Better Locally Private Sparse Estimation Given Multiple Samples Per UserYuheng Ma, Ke Jia, Hanfang YangICML 2024 · 2 citations
