Global Optimization with a Power-Transformed Objective and Gaussian Smoothing
Chen Xu
摘要
We propose a novel method that solves global optimization problems in two steps: (1) perform a (exponential) power-N transformation to the not-necessarily differentiable objective function f and get f N , and (2) optimize the Gaussian-smoothed f N with stochastic approximations. Under mild conditions on f , for any δ > 0, we prove that with a sufficiently large power N δ , this method converges to a solution in the δ-neighborhood of f 's global optimum point. The convergence rate is O(d 2 σ 4 ε -2 ), which is faster than both the standard and single-loop homotopy methods if σ is preselected to be in (0, 1). In most of the experiments performed, our method produces better solutions than other algorithms that also apply smoothing techniques.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper4
- Towards Evaluating the Robustness of Neural NetworksNicholas Carlini, David A. WagnerS&P 2017 · 被引用 9,786 次
- Single Loop Gaussian Homotopy Method for Non-convex OptimizationHidenori Iwakiri, Yuhang Wang, Shinji Ito, Akiko TakedaNeurIPS 2022 · 被引用 29 次
- Generalizing Gaussian Smoothing for Random SearchKatelyn Gao, Ozan SenerICML 2022 · 被引用 22 次
- Continuation Path Learning for Homotopy OptimizationXi Lin, Zhiyuan Yang, Xiaoyuan Zhang, Qingfu ZhangICML 2023 · 被引用 18 次
相关 Paper
- Dynamic Anisotropic Smoothing for Noisy Derivative-Free OptimizationSam Reifenstein, Timothée G. Leleu, Yoshihisa YamamotoICML 2024 · 被引用 3 次
- Optimal Randomized First-Order Methods for Least-Squares ProblemsJonathan Lacotte, Mert PilanciICML 2020 · 被引用 30 次
- Gradient-Normalized Smoothness for Optimization with Approximate HessiansAndrei Semenov, Martin Jaggi, Nikita DoikovICLR 2026 · 被引用 8 次
- A Simple and Efficient Smoothing Method for Faster Optimization and Local ExplorationKevin Scaman, Ludovic Dos Santos, Merwan Barlier, Igor ColinNeurIPS 2020 · 被引用 5 次
- Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient DescentSharan Vaswani, Benjamin Dubois-Taine, Reza BabanezhadICML 2022
