Minimax Optimal Rate for Parameter Estimation in Multivariate Deviated Models
Dat Do, Huy Nguyen, Khai Nguyen, Nhat Ho
摘要
We study the maximum likelihood estimation (MLE) in the multivariate deviated model where the data are generated from the density function in which is a known function, and are unknown parameters to estimate. The main challenges in deriving the convergence rate of the MLE mainly come from two issues: (1) The interaction between the function and the density function ; (2) The deviated proportion can go to the extreme points of as the sample size tends to infinity. To address these challenges, we develop the distinguishability condition to capture the linear independent relation between the function and the density function . We then provide comprehensive convergence rates of the MLE via the vanishing rate of to zero as well as the distinguishability of two functions and .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of ExpertsHuy Nguyen, Nhat Ho, Alessandro RinaldoNeurIPS 2024 · 被引用 35 次
- On Minimax Estimation of Parameters in Softmax-Contaminated Mixture of ExpertsFanqi Yan, Huy Nguyen, Dung Le, Pedram Akbarian 等NeurIPS 2025 · 被引用 1 次
- Statistical Advantages of Perturbing Cosine Router in Mixture of ExpertsHuy Nguyen, Pedram Akbarian, Huyen Trang Pham, Thien Trang Nguyen Vu 等ICLR 2025
它引用的顶会 Paper3
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- KSD Aggregated Goodness-of-fit TestAntonin Schrab, Benjamin Guedj, Arthur GrettonNeurIPS 2022 · 被引用 26 次
- Beyond black box densities: Parameter learning for the deviated componentsDat Do, Nhat Ho, XuanLong NguyenNeurIPS 2022 · 被引用 2 次
相关 Paper
- Demystifying Softmax Gating Function in Gaussian Mixture of ExpertsHuy Nguyen, TrungTin Nguyen, Nhat HoNeurIPS 2023 · 被引用 44 次
- Refined Convergence Rates for Maximum Likelihood Estimation under Finite Mixture ModelsTudor A. Manole, Nhat HoICML 2022 · 被引用 26 次
- A General Theory for Softmax Gating Multinomial Logistic Mixture of ExpertsHuy Nguyen, Pedram Akbarian, TrungTin Nguyen, Nhat HoICML 2024 · 被引用 28 次
- Minimax-Optimal Univariate Function Selection in Sparse Additive Models: Rates, Adaptation, and the Estimation-Selection GapShixiang LiuNeurIPS 2025 · 被引用 1 次
- Maximum Likelihood Estimation is All You Need for Well-Specified Covariate ShiftJiawei Ge, Shange Tang, Jianqing Fan, Cong Ma 等ICLR 2024 · 被引用 16 次
