Learning to compute Gröbner bases
Hiroshi Kera, Yuki Ishihara, Yuta Kambe, Tristan Vaccon, Kazuhiro Yokoyama
摘要
Solving a polynomial system, or computing an associated Gröbner basis, has been a fundamental task in computational algebra. However, it is also known for its notorious doubly exponential time complexity in the number of variables in the worst case. This paper is the first to address the learning of Gröbner basis computation with Transformers. The training requires many pairs of a polynomial system and the associated Gröbner basis, raising two novel algebraic problems: random generation of Gröbner bases and transforming them into non-Gröbner ones, termed as backward Gröbner problem. We resolve these problems with 0-dimensional radical ideals, the ideals appearing in various applications. Further, we propose a hybrid input embedding to handle coefficient tokens with continuity bias and avoid the growth of the vocabulary set. The experiments show that our dataset generation method is a few orders of magnitude faster than a naive approach, overcoming a crucial challenge in learning to compute Gröbner bases, and Gröbner computation is learnable in a particular class.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Computational Algebra with Attention: Transformer Oracles for Border Basis AlgorithmsHiroshi Kera, Nico Pelleriti, Yuki Ishihara, Max Zimmer 等NeurIPS 2025 · 被引用 8 次
- Regress, Don't Guess: A Regression-like Loss on Number Tokens for Language ModelsJonas Zausinger, Lars Pennig, Anamarija Kozina, Sean Sdahl 等ICML 2025
- HATSolver: Learning Gröbner Bases with Hierarchical Attention TransformersMohamed Malhou, Ludovic Perret, Kristin E. LauterICLR 2026
- Making Hard Problems Easier with Custom Data Distributions and Loss Regularization: A Case Study in Modular ArithmeticEshika Saxena, Alberto Alfarano, Emily Wenger, Kristin E. LauterICML 2025
它引用的顶会 Paper18
- Reformer: The Efficient TransformerNikita Kitaev, Lukasz Kaiser, Anselm LevskayaICLR 2020 · 被引用 2,878 次
- Faith and Fate: Limits of Transformers on CompositionalityNouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li 等NeurIPS 2023 · 被引用 728 次
- Deep Learning For Symbolic MathematicsGuillaume Lample, François ChartonICLR 2020 · 被引用 477 次
- End-to-end Symbolic Regression with TransformersPierre-Alexandre Kamienny, Stéphane d'Ascoli, Guillaume Lample, François ChartonNeurIPS 2022 · 被引用 320 次
- Neural Symbolic Regression that scalesLuca Biggio, Tommaso Bendinelli, Alexander Neitz, Aurélien Lucchi 等ICML 2021 · 被引用 251 次
相关 Paper
- Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive MatricesJingyi Xu, Tushar Vaidya, Yufei Wu, Saket Chandra 等CVPR 2023
- Towards Learning High-Precision Least Squares Algorithms with Sequence ModelsJerry Weihong Liu, Jessica Grogan, Owen M. Dugan, Ashish Rao 等ICLR 2025
- Learning and Transferring Sparse Contextual Bigrams with Linear TransformersYunwei Ren, Zixuan Wang, Jason D. LeeNeurIPS 2024 · 被引用 9 次
- The Complexity of Algebraic Algorithms for LWEMatthias Johann SteinerEUROCRYPT 2024 · 被引用 5 次
- Neural Sum-of-Squares: Certifying the Nonnegativity of Polynomials with TransformersNico Pelleriti, Christoph Spiegel, Shiwei Liu, David Martínez-Rubio 等ICLR 2026 · 被引用 2 次
