EGG-SR: Embedding Symbolic Equivalence into Symbolic Regression via Equality Graph
Nan Jiang, Ziyi Wang, Yexiang Xue
Abstract
Symbolic regression seeks to uncover physical laws from experimental data by searching for closedform expressions, which is an important task in AI-driven scientific discovery. Yet the exponential growth of the search space of expression renders the task computationally challenging. A promising yet underexplored direction for reducing the search space and accelerating training lies in symbolic equivalence: many expressions, although syntactically different, define the same function -for example, log(𝑥 2 1 𝑥 3 2 ), log(𝑥 2 1 ) + log(𝑥 3 2 ), and 2 log(𝑥 1 ) + 3 log(𝑥 2 ). Existing algorithms treat such variants as distinct outputs, leading to redundant exploration and slow learning. We introduce Egg-SR, a unified framework that integrates symbolic equivalence into a class of modern symbolic regression methods, including Monte Carlo Tree Search (MCTS), Deep Reinforcement Learning (DRL), and Large Language Models (LLMs). Egg-SR compactly represents equivalent expressions through the proposed Egg module (via equality graphs), accelerating learning by: (1) pruning redundant subtree exploration in Egg-MCTS, (2) aggregating rewards across equivalent generated sequences in Egg-DRL, and (3) enriching feedback prompts in Egg-LLM. Theoretically, we show the benefit of embedding Egg into learning: it tightens the regret bound of MCTS and reduces the variance of the DRL gradient estimator. Empirically, Egg-SR consistently enhances a class of symbolic regression models across several benchmarks, discovering more accurate expressions within the same time limit. Project page is at: https://nan-jiang-group.github.io/egg-sr . 1 𝑥 3 2 ), log(𝑥 2 1 ) + log(𝑥 3 2 ), and 2 log(𝑥 1 ) + 3 log(𝑥 2 ) all represent the same math function and are therefore symbolically equivalent. Ideally, a well-trained model would recognize such equivalence and assign identical goodness-of-fit, rewards, or losses to the corresponding predicted expressions (Allamanis et al., 2017) , since these expressions produce identical functional outputs and attain the same prediction error on the dataset. In the literature, existing SR algorithms treat these expressions as distinct outputs, leading to redundant exploration of the search space and slow training. The main challenge of this direction is: how to represent symbolically-equivalent expressions and embed them into modern learning frameworks in a unified and scalable manner?
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext aae8d223-de2b-4fba-aaa2-08203ab2587eBuilds on16
- Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientsBrenden K. Petersen, Mikel Landajuela, T. Nathan Mundhenk, Cláudio Prata Santiago et al.ICLR 2021 · 444 citations
- End-to-end Symbolic Regression with TransformersPierre-Alexandre Kamienny, Stéphane d'Ascoli, Guillaume Lample, François ChartonNeurIPS 2022 · 320 citations
- AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitySilviu-Marian Udrescu, Andrew K. Tan, Jiahai Feng, Orisvaldo Neto et al.NeurIPS 2020 · 267 citations
- egg: Fast and extensible equality saturationMax Willsey, Chandrakana Nandi, Yisu Remy Wang, Oliver Flatt et al.POPL 2021 · 170 citations
- A Unified Framework for Deep Symbolic RegressionMikel Landajuela, Chak Shing Lee, Jiachen Yang, Ruben Glatt et al.NeurIPS 2022 · 160 citations
Related papers
- Graph-based Symbolic Regression with Invariance and Constraint EncodingZiyu Xiang, Kenna Ashen, Xiaofeng Qian, Xiaoning QianNeurIPS 2025 · 5 citations
- Deep Generative Symbolic RegressionSamuel Holt, Zhaozhi Qian, Mihaela van der SchaarICLR 2023 · 4 citations
- LLM-SR: Scientific Equation Discovery via Programming with Large Language ModelsParshin Shojaee, Kazem Meidani, Shashank Gupta, Amir Barati Farimani et al.ICLR 2025
- RAG-SR: Retrieval-Augmented Generation for Neural Symbolic RegressionHengzhe Zhang, Qi Chen, Bing Xue, Wolfgang Banzhaf et al.ICLR 2025
- Reinforcement Symbolic Regression MachineYilong Xu, Yang Liu, Hao SunICLR 2024 · 17 citations
