Lion Secretly Solves a Constrained Optimization: As Lyapunov Predicts

Theoretical Exploration of Lion Optimizer We unveil the theoretical foundation of the Lion optimizer, which, despite its empirical success, lacked a clear theoretical basis. Our work establishes that Lion is not just an empirically effective optimizer but is theoretically grounded in solving a specific bound-constrained optimization problem.