Global Optimization with a Power-Transformed Objective and Gaussian Smoothing
Chen Xu
Abstract
We propose a novel method that solves global optimization problems in two steps: (1) perform a (exponential) power-N transformation to the not-necessarily differentiable objective function f and get f N , and (2) optimize the Gaussian-smoothed f N with stochastic approximations. Under mild conditions on f , for any δ > 0, we prove that with a sufficiently large power N δ , this method converges to a solution in the δ-neighborhood of f 's global optimum point. The convergence rate is O(d 2 σ 4 ε -2 ), which is faster than both the standard and single-loop homotopy methods if σ is preselected to be in (0, 1). In most of the experiments performed, our method produces better solutions than other algorithms that also apply smoothing techniques.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on4
- Towards Evaluating the Robustness of Neural NetworksNicholas Carlini, David A. WagnerS&P 2017 · 9,786 citations
- Single Loop Gaussian Homotopy Method for Non-convex OptimizationHidenori Iwakiri, Yuhang Wang, Shinji Ito, Akiko TakedaNeurIPS 2022 · 29 citations
- Generalizing Gaussian Smoothing for Random SearchKatelyn Gao, Ozan SenerICML 2022 · 22 citations
- Continuation Path Learning for Homotopy OptimizationXi Lin, Zhiyuan Yang, Xiaoyuan Zhang, Qingfu ZhangICML 2023 · 18 citations
Related papers
- Dynamic Anisotropic Smoothing for Noisy Derivative-Free OptimizationSam Reifenstein, Timothée G. Leleu, Yoshihisa YamamotoICML 2024 · 3 citations
- Optimal Randomized First-Order Methods for Least-Squares ProblemsJonathan Lacotte, Mert PilanciICML 2020 · 30 citations
- Gradient-Normalized Smoothness for Optimization with Approximate HessiansAndrei Semenov, Martin Jaggi, Nikita DoikovICLR 2026 · 8 citations
- A Simple and Efficient Smoothing Method for Faster Optimization and Local ExplorationKevin Scaman, Ludovic Dos Santos, Merwan Barlier, Igor ColinNeurIPS 2020 · 5 citations
- Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient DescentSharan Vaswani, Benjamin Dubois-Taine, Reza BabanezhadICML 2022
