Deep Legendre Transform
Aleksey Minabutdinov, Patrick Cheridito
摘要
We introduce a novel deep learning algorithm for computing convex conjugates of differentiable convex functions, a fundamental operation in convex analysis with various applications in different fields such as optimization, control theory, physics and economics. While traditional numerical methods suffer from the curse of dimensionality and become computationally intractable in high dimensions, more recent neural network-based approaches scale better, but have mostly been studied with the aim of solving optimal transport problems and require the solution of complicated optimization or max-min problems. Using an implicit Fenchel formulation of convex conjugation, our approach facilitates an efficient gradient-based framework for the minimization of approximation errors and, as a byproduct, also provides a posteriori estimates of the approximation accuracy. Numerical experiments demonstrate our method's ability to deliver accurate results across different high-dimensional examples. Moreover, by employing symbolic regression with Kolmogorov-Arnold networks, it is able to obtain the exact convex conjugates of specific convex functions. Code is available at https://github.com/lexmar07/Deep-Legendre-Transform * Corresponding author 1 The Legendre transform-a fundamental operation for switching between dual formulations and variables-has broad utility across thermodynamics, mechanics, optimization, and economics. Key applications include: switching between thermodynamic potentials by exchanging extensive variables (entropy, volume) for intensive conjugates (temperature, pressure) in physics; constructing Moreau envelopes in variational analysis; deriving indirect utility and profit functions in economics; and computing convex potentials in optimal transport. Recent work has further demonstrated applications in approximate dynamic programming Sharifi Kolarijani and Mohajerin Esfahani [2023] and self-concordant smoothing Adeoye and Bemporad [2023]. This paper introduces the Deep Legendre Transform algorithm, establishes its theoretical foundations, and demonstrates its application to optimal-control problems governed by Hamilton-Jacobi equations.
39th Conference on Neural Information Processing Systems (NeurIPS 2025).
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Optimal transport mapping via input convex neural networksAshok Vardhan Makkuva, Amirhossein Taghvaei, Sewoong Oh, Jason D. LeeICML 2020 · 被引用 254 次
- Wasserstein-2 Generative NetworksAlexander Korotin, Vage Egiazarian, Arip Asadulaev, Alexander Safin 等ICLR 2021 · 被引用 128 次
- Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 BenchmarkAlexander Korotin, Lingxiao Li, Aude Genevay, Justin M. Solomon 等NeurIPS 2021 · 被引用 124 次
- On amortizing convex conjugates for optimal transportBrandon AmosICLR 2023 · 被引用 1 次
- KAN: Kolmogorov-Arnold NetworksZiming Liu, Yixuan Wang, Sachin Vaidya, Fabian Ruehle 等ICLR 2025
相关 Paper
- Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep LearningJulius Berner, Markus Dablander, Philipp GrohsNeurIPS 2020 · 被引用 58 次
- An Interpretable Approach to the Solutions of High-Dimensional Partial Differential EquationsLulu Cao, Yufei Liu, Zhenzhong Wang, Dejun Xu 等AAAI 2024 · 被引用 15 次
- On Solution Functions of Optimization: Universal Approximation and Covering Number BoundsMing Jin, Vanshaj Khattar, Harshal Kaushik, Bilgehan Sel 等AAAI 2023 · 被引用 15 次
- A Deep Conjugate Direction Method for Iteratively Solving Linear SystemsAyano Kaneda, Osman Akar, Jingyu Chen, Victoria Alicia Trevino Kala 等ICML 2023 · 被引用 17 次
- Neural operators meet conjugate gradients: The FCG-NO method for efficient PDE solvingAlexander Rudikov, Vladimir Fanaskov, Ekaterina A. Muravleva, Yuri M. Laevsky 等ICML 2024 · 被引用 14 次
