Effective Neural Approximations for Geometric Optimization Problems
Samantha Chen, Oren Ciolli, Anastasios Sidiropoulos, Yusu Wang
Abstract
Neural networks offer a promising data-driven approach to tackle computationally challenging optimization problems. In this work, we introduce neural approximation frameworks for a family of geometric "extent measure" problems, including shape-fitting descriptors (e.g. minimum enclosing ball or annulus). Central to our approach is the alignment of our neural model with a new variant of the classical ε -kernel technique from computational geometry. In particular, we develop a new relaxed-ε -kernel theory that maintains the approximation guarantees of the classical ε -kernels but with the crucial benefit that it can be implemented with bounded model complexity (i.e, constant number of parameters) by the simple SumFormer neural network. This leads to a simple neural model that approximate quantities such as the directional width of any input point set and empirically shows good out-of-distribution generalization. Many geometric extent measures, such as the minimum enclosing spherical shell, cannot be directly captured by ε -kernels. To this end, we show that an encode-process-decode framework with our kernel-approximating NN used as the “process” module can approximate such extent measures, again, with bounded model complexity where parameters scale only with the approximation error ε and not the size of the input set. Empirical results on diverse point-cloud datasets demonstrate the practical performance of our models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- What graph neural networks cannot learn: depth vs widthAndreas LoukasICLR 2020 · 336 citations
- Neural Execution of Graph AlgorithmsPetar Velickovic, Rex Ying, Matilde Padovano, Raia Hadsell et al.ICLR 2020 · 192 citations
- The CLRS Algorithmic Reasoning BenchmarkPetar Velickovic, Adrià Puigdomènech Badia, David Budden, Razvan Pascanu et al.ICML 2022 · 118 citations
- Are Graph Neural Networks Optimal Approximation Algorithms?Morris Yau, Nikolaos Karalias, Eric Lu, Jessica Xu et al.NeurIPS 2024 · 23 citations
- Point TransformerHengshuang Zhao, Li Jiang, Jiaya Jia, Philip H. S. Torr et al.ICCV 2021 · 23 citations
Related papers
- Neural approximation of Wasserstein distance via a universal architecture for symmetric and factorwise group invariant functionsSamantha Chen, Yusu WangNeurIPS 2023 · 4 citations
- Neural Network Approximation based on Hausdorff distance of Tropical ZonotopesPanagiotis Misiakos, Georgios Smyrnis, George Retsinas, Petros MaragosICLR 2022 · 10 citations
- On the Representation Power of Set Pooling NetworksChristian Bueno, Alan HyltonNeurIPS 2021 · 13 citations
- Estimating Shape Distances on Neural Representations with Limited SamplesDean A. Pospisil, Brett W. Larsen, Sarah E. Harvey, Alex H. WilliamsICLR 2024 · 5 citations
- On the Spectral Differences Between NTK and CNTK and Their Implications for Point Cloud RecognitionYuanqu Mou, Chang Gou, Haiyang Bai, Jia LiuICLR 2026
