Minimax Optimal Rate for Parameter Estimation in Multivariate Deviated Models
Dat Do, Huy Nguyen, Khai Nguyen, Nhat Ho
Abstract
We study the maximum likelihood estimation (MLE) in the multivariate deviated model where the data are generated from the density function in which is a known function, and are unknown parameters to estimate. The main challenges in deriving the convergence rate of the MLE mainly come from two issues: (1) The interaction between the function and the density function ; (2) The deviated proportion can go to the extreme points of as the sample size tends to infinity. To address these challenges, we develop the distinguishability condition to capture the linear independent relation between the function and the density function . We then provide comprehensive convergence rates of the MLE via the vanishing rate of to zero as well as the distinguishability of two functions and .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d3d7e2e2-dd09-4fb3-aece-a597ea12abc5Cited by top-tier papers3
- Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of ExpertsHuy Nguyen, Nhat Ho, Alessandro RinaldoNeurIPS 2024 · 35 citations
- On Minimax Estimation of Parameters in Softmax-Contaminated Mixture of ExpertsFanqi Yan, Huy Nguyen, Dung Le, Pedram Akbarian et al.NeurIPS 2025 · 1 citation
- Statistical Advantages of Perturbing Cosine Router in Mixture of ExpertsHuy Nguyen, Pedram Akbarian, Huyen Trang Pham, Thien Trang Nguyen Vu et al.ICLR 2025
Builds on3
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- KSD Aggregated Goodness-of-fit TestAntonin Schrab, Benjamin Guedj, Arthur GrettonNeurIPS 2022 · 26 citations
- Beyond black box densities: Parameter learning for the deviated componentsDat Do, Nhat Ho, XuanLong NguyenNeurIPS 2022 · 2 citations
Related papers
- Demystifying Softmax Gating Function in Gaussian Mixture of ExpertsHuy Nguyen, TrungTin Nguyen, Nhat HoNeurIPS 2023 · 44 citations
- Refined Convergence Rates for Maximum Likelihood Estimation under Finite Mixture ModelsTudor A. Manole, Nhat HoICML 2022 · 26 citations
- A General Theory for Softmax Gating Multinomial Logistic Mixture of ExpertsHuy Nguyen, Pedram Akbarian, TrungTin Nguyen, Nhat HoICML 2024 · 28 citations
- Minimax-Optimal Univariate Function Selection in Sparse Additive Models: Rates, Adaptation, and the Estimation-Selection GapShixiang LiuNeurIPS 2025 · 1 citation
- Maximum Likelihood Estimation is All You Need for Well-Specified Covariate ShiftJiawei Ge, Shange Tang, Jianqing Fan, Cong Ma et al.ICLR 2024 · 16 citations
