Visual Diffusion Models are Geometric Solvers
Nir Goren, Shai Yehezkel, Omer Dahary, Andrey Voynov, Or Patashnik, Daniel Cohen-Or
Abstract
In this paper we show that visual diffusion models can serve as effective geometric solvers: they can directly reason about geometric problems by working in pixel space. We first demonstrate this on the Inscribed Square Problem, a long-standing problem in geometry that asks whether every Jordan curve contains four points forming a square. We then extend the approach to two other well-known hard geometric problems: the Steiner Tree Problem and the Simple Polygon Problem. Our method treats each problem instance as an image and trains a standard visual diffusion model that transforms Gaussian noise into an image representing a valid approximate solution that closely matches the exact one. The model learns to transform noisy geometric structures into correct configurations, effectively recasting geometric reasoning as image generation. Unlike prior work that necessitates specialized architectures and domain-specific adaptations when applying diffusion to parametric geometric representations, we employ a standard visual diffusion model that operates on the visual representation of the problem. This simplicity highlights a surprising bridge between generative modeling and geometric problem solving. Beyond the specific problems studied here, our results point toward a broader paradigm: operating in image space provides a general and practical framework for approximating notoriously hard problems, and opens the door to tackling a far wider class of challenging geometric tasks. Code is available at: https://kariander1. github.io/visual-geo-solver/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- DiffThinker: Towards Generative Multimodal Reasoning with Diffusion ModelsZefeng He, Xiaoye Qu, Yafu Li, Tong Zhu et al.ICML 2026 · 13 citations
- DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose EstimationTony Danjun Wang, Tolga Birdal, Nassir Navab, Lennart BastianICML 2026
Builds on9
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- DIFUSCO: Graph-based Diffusion Solvers for Combinatorial OptimizationZhiqing Sun, Yiming YangNeurIPS 2023 · 356 citations
- Diffusion Models as Plug-and-Play PriorsAlexandros Graikos, Nikolay Malkin, Nebojsa Jojic, Dimitris SamarasNeurIPS 2022 · 323 citations
- Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial OptimizationYang Li, Jinpei Guo, Runzhong Wang, Hongyuan Zha et al.NeurIPS 2024 · 65 citations
- A Diffusion Model Framework for Unsupervised Neural Combinatorial OptimizationSebastian Sanokowski, Sepp Hochreiter, Sebastian LehnerICML 2024 · 60 citations
Related papers
- PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion ModelsJiacheng Chen, Ruizhi Deng, Yasutaka FurukawaNeurIPS 2023 · 52 citations
- Puzzlefusion: Unleashing the Power of Diffusion Models for Spatial Puzzle SolvingSepidehsadat (Sepid) Hossieni, Mohammad Amin Shabani, Saghar Irandoust, Yasutaka FurukawaNeurIPS 2023 · 29 citations
- Neural Approximate Mirror Maps for Constrained Diffusion ModelsBerthy Feng, Ricardo Baptista, Katherine L. BoumanICLR 2025
- InstructDiffusion: A Generalist Modeling Interface for Vision TasksZigang Geng, Binxin Yang, Tiankai Hang, Chen Li et al.CVPR 2024
- Plug-and-Play Diffusion Features for Text-Driven Image-to-Image TranslationNarek Tumanyan, Michal Geyer, Shai Bagon, Tali DekelCVPR 2023
