arXiv AI By Letian Huang, Xiangyu Wang, Haowei Lin, Di He

L2G-SR: Learning to Guide LLM-based Symbolic Regression

Read the original on arXiv AI →

L2G-SR is a framework that enhances large language model (LLM)-based symbolic regression by incorporating a learned structural verifier. The verifier uses tree edit distance (TED) to assess structural similarity between candidate equations and the target, complementing numerical error during search. Experiments on LLM-SRBench show that L2G-SR achieves state‑of‑the‑art performance in numerical fit, equation‑level accuracy, and TED across various LLM backbones and domains.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jun 4

Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs

arXiv:2606. 04360v1 Announce Type: cross Abstract: Symbolic regression (SR) discovers compact mathematical expressions from data, yet recent LLM-based evolutionary methods remain sample-inefficient because they rely mainly on scalar feedback such as MSE.

By Xinyu Pang, Zhanke Zhou, Xuan Li, Fangrui Lv, Shanshan Wei, Sen Cui, Bo Han, Changshui Zhang
arXiv AI
Oct 9

RISR: Residual-Informed Scientific Equation Discovery with Large Language Models

The paper introduces RISR, a residual‑informed approach for symbolic regression that leverages error patterns to guide formula discovery. A residual encoder transforms aligned inputs, targets, predictions, and residuals into tokens that condition a language model to propose candidate equations, while a dual‑view relational encoder predicts the utility of corrections. Evaluated on the LLM‑SRBench, RISR achieves higher in‑distribution and out‑of‑distribution accuracy than baseline methods, demonstrating that incorporating residual information can improve numerical equation recovery.

By Haobo Li, Wenshuo Zhang, Wenxiao Zhao, Eunseo Jung, Rui Sheng, Yushi Sun, Peiqin Zhuang, Hao Chen, Fenghua Ling
arXiv Machine Learning
Aug 31

Probabilistic Symbolic Regression for Equation Discovery via Operator-induced and Regularized Symbolic Forests

The paper presents a probabilistic symbolic regression framework that models mathematical expressions as ensembles of symbolic trees, using a regularizing prior to control complexity and an Occam’s window-based posterior to capture uncertainty across plausible models. It provides theoretical guarantees on posterior concentration, including near‑parametric rates when an exact finite formula exists and oracle results under misspecification. Empirical results show the method outperforms state‑of‑the‑art competitors in predictive accuracy, symbolic complexity, and structural recovery on benchmark scientific equations and a materials discovery task.

By Somjit Roy, Pritam Dey, Bani K. Mallick, Debdeep Pati