GenSR: Symbolic regression based on equation generative space
Qian Li, Yuxiao Hu, Juncheng Liu, Yuntian Chen
摘要
Symbolic Regression (SR) tries to reveal the hidden equations behind observed data. However, most methods search within a discrete equation space, where the structural modifications of equations rarely align with their numerical behavior, leaving fitting error feedback too noisy to guide exploration. To address this challenge, we propose GenSR, a generative latent space–based SR framework following the "map construction coarse localization fine search" paradigm. Specifically, GenSR first pretrains a dual-branch Conditional Variational Autoencoder (CVAE) to reparameterize symbolic equations into a generative latent space with symbolic continuity and local numerical smoothness. This space can be regarded as a well-structured "map" of the equation space, providing directional signals for search. At inference, the CVAE coarsely localizes the input data to promising regions in the latent space. Then, a modified CMA-ES refines the candidate region, leveraging smooth latent gradients. From a Bayesian perspective, GenSR reframes SR task as maximizing the conditional distribution , with CVAE training achieving this objective through the Evidence Lower Bound (ELBO). This new perspective provides a theoretical guarantee for the effectiveness of GenSR. Extensive experiments show that GenSR jointly optimizes predictive accuracy, expression simplicity, and computational efficiency, while remaining robust under noise.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper20
- Deep Learning For Symbolic MathematicsGuillaume Lample, François ChartonICLR 2020 · 被引用 477 次
- Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientsBrenden K. Petersen, Mikel Landajuela, T. Nathan Mundhenk, Cláudio Prata Santiago 等ICLR 2021 · 被引用 444 次
- End-to-end Symbolic Regression with TransformersPierre-Alexandre Kamienny, Stéphane d'Ascoli, Guillaume Lample, François ChartonNeurIPS 2022 · 被引用 320 次
- AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitySilviu-Marian Udrescu, Andrew K. Tan, Jiahai Feng, Orisvaldo Neto 等NeurIPS 2020 · 被引用 267 次
- Neural Symbolic Regression that scalesLuca Biggio, Tommaso Bendinelli, Alexander Neitz, Aurélien Lucchi 等ICML 2021 · 被引用 251 次
相关 Paper
- Deep Generative Symbolic Regression with Monte-Carlo-Tree-SearchPierre-Alexandre Kamienny, Guillaume Lample, Sylvain Lamprier, Marco VirgolinICML 2023 · 被引用 50 次
- Deep Generative Symbolic RegressionSamuel Holt, Zhaozhi Qian, Mihaela van der SchaarICLR 2023 · 被引用 4 次
- EGG-SR: Embedding Symbolic Equivalence into Symbolic Regression via Equality GraphNan Jiang, Ziyi Wang, Yexiang XueICLR 2026 · 被引用 3 次
- Transformer-based Planning for Symbolic RegressionParshin Shojaee, Kazem Meidani, Amir Barati Farimani, Chandan K. ReddyNeurIPS 2023 · 被引用 116 次
- Controllable Neural Symbolic RegressionTommaso Bendinelli, Luca Biggio, Pierre-Alexandre KamiennyICML 2023 · 被引用 22 次
