Deep Legendre Transform
Aleksey Minabutdinov, Patrick Cheridito
Abstract
We introduce a novel deep learning algorithm for computing convex conjugates of differentiable convex functions, a fundamental operation in convex analysis with various applications in different fields such as optimization, control theory, physics and economics. While traditional numerical methods suffer from the curse of dimensionality and become computationally intractable in high dimensions, more recent neural network-based approaches scale better, but have mostly been studied with the aim of solving optimal transport problems and require the solution of complicated optimization or max-min problems. Using an implicit Fenchel formulation of convex conjugation, our approach facilitates an efficient gradient-based framework for the minimization of approximation errors and, as a byproduct, also provides a posteriori estimates of the approximation accuracy. Numerical experiments demonstrate our method's ability to deliver accurate results across different high-dimensional examples. Moreover, by employing symbolic regression with Kolmogorov-Arnold networks, it is able to obtain the exact convex conjugates of specific convex functions. Code is available at https://github.com/lexmar07/Deep-Legendre-Transform * Corresponding author 1 The Legendre transform-a fundamental operation for switching between dual formulations and variables-has broad utility across thermodynamics, mechanics, optimization, and economics. Key applications include: switching between thermodynamic potentials by exchanging extensive variables (entropy, volume) for intensive conjugates (temperature, pressure) in physics; constructing Moreau envelopes in variational analysis; deriving indirect utility and profit functions in economics; and computing convex potentials in optimal transport. Recent work has further demonstrated applications in approximate dynamic programming Sharifi Kolarijani and Mohajerin Esfahani [2023] and self-concordant smoothing Adeoye and Bemporad [2023]. This paper introduces the Deep Legendre Transform algorithm, establishes its theoretical foundations, and demonstrates its application to optimal-control problems governed by Hamilton-Jacobi equations.
39th Conference on Neural Information Processing Systems (NeurIPS 2025).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Optimal transport mapping via input convex neural networksAshok Vardhan Makkuva, Amirhossein Taghvaei, Sewoong Oh, Jason D. LeeICML 2020 · 254 citations
- Wasserstein-2 Generative NetworksAlexander Korotin, Vage Egiazarian, Arip Asadulaev, Alexander Safin et al.ICLR 2021 · 128 citations
- Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 BenchmarkAlexander Korotin, Lingxiao Li, Aude Genevay, Justin M. Solomon et al.NeurIPS 2021 · 124 citations
- On amortizing convex conjugates for optimal transportBrandon AmosICLR 2023 · 1 citation
- KAN: Kolmogorov-Arnold NetworksZiming Liu, Yixuan Wang, Sachin Vaidya, Fabian Ruehle et al.ICLR 2025
Related papers
- Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep LearningJulius Berner, Markus Dablander, Philipp GrohsNeurIPS 2020 · 58 citations
- An Interpretable Approach to the Solutions of High-Dimensional Partial Differential EquationsLulu Cao, Yufei Liu, Zhenzhong Wang, Dejun Xu et al.AAAI 2024 · 15 citations
- On Solution Functions of Optimization: Universal Approximation and Covering Number BoundsMing Jin, Vanshaj Khattar, Harshal Kaushik, Bilgehan Sel et al.AAAI 2023 · 15 citations
- A Deep Conjugate Direction Method for Iteratively Solving Linear SystemsAyano Kaneda, Osman Akar, Jingyu Chen, Victoria Alicia Trevino Kala et al.ICML 2023 · 17 citations
- Neural operators meet conjugate gradients: The FCG-NO method for efficient PDE solvingAlexander Rudikov, Vladimir Fanaskov, Ekaterina A. Muravleva, Yuri M. Laevsky et al.ICML 2024 · 14 citations
