Deep Learning For Symbolic Mathematics
Guillaume Lample, François Charton
Abstract
Neural networks have a reputation for being better at solving statistical or approximate problems than at performing calculations or working with symbolic data. In this paper, we show that they can be surprisingly good at more elaborated tasks in mathematics, such as symbolic integration and solving differential equations. We propose a syntax for representing these mathematical problems, and methods for generating large datasets that can be used to train sequence-to-sequence models. We achieve results that outperform commercial Computer Algebra Systems such as Matlab or Mathematica.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d6b2980a-989c-494c-8212-46e4cc0673daCited by top-tier papers85
- How Neural Networks Extrapolate: From Feedforward to Graph Neural NetworksKeyulu Xu, Mozhi Zhang, Jingling Li, Simon Shaolei Du et al.ICLR 2021 · 364 citations
- End-to-end Symbolic Regression with TransformersPierre-Alexandre Kamienny, Stéphane d'Ascoli, Guillaume Lample, François ChartonNeurIPS 2022 · 320 citations
- MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised TrainingYizhi Li, Ruibin Yuan, Ge Zhang, Yinghao Ma et al.ICLR 2024 · 277 citations
- HyperTree Proof Search for Neural Theorem ProvingGuillaume Lample, Timothée Lacroix, Marie-Anne Lachaux, Aurélien Rodriguez et al.NeurIPS 2022 · 271 citations
- Neural Symbolic Regression that scalesLuca Biggio, Tommaso Bendinelli, Alexander Neitz, Aurélien Lucchi et al.ICML 2021 · 251 citations
Related papers
- Symbolic Brittleness in Sequence Models: On Systematic Generalization in Symbolic MathematicsSean Welleck, Peter West, Jize Cao, Yejin ChoiAAAI 2022 · 32 citations
- Deep symbolic regression for recurrence predictionStéphane d'Ascoli, Pierre-Alexandre Kamienny, Guillaume Lample, François ChartonICML 2022 · 22 citations
- Neuro-Symbolic Data Generation for Math ReasoningZenan Li, Zhi Zhou, Yuan Yao, Xian Zhang et al.NeurIPS 2024 · 35 citations
- Neural-Symbolic Integration: A Compositional PerspectiveEfthymia Tsamoura, Timothy M. Hospedales, Loizos MichaelAAAI 2021 · 85 citations
- Neural Machine Translation for Mathematical FormulaeFelix Petersen, Moritz Schubotz, André Greiner-Petter, Bela GippACL 2023 · 6 citations
