arXiv AI By Haobo Li, Wenshuo Zhang, Wenxiao Zhao, Eunseo Jung, Rui Sheng, Yushi Sun, Peiqin Zhuang, Hao Chen, Fenghua Ling

RISR: Residual-Informed Scientific Equation Discovery with Large Language Models

Read the original on arXiv AI →

The paper introduces RISR, a residual‑informed approach for symbolic regression that leverages error patterns to guide formula discovery. A residual encoder transforms aligned inputs, targets, predictions, and residuals into tokens that condition a language model to propose candidate equations, while a dual‑view relational encoder predicts the utility of corrections. Evaluated on the LLM‑SRBench, RISR achieves higher in‑distribution and out‑of‑distribution accuracy than baseline methods, demonstrating that incorporating residual information can improve numerical equation recovery.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 21

MOSAIC-SR: Transformer-Guided Symbolic Regression for Scientific Equation Recovery

MOSAIC‑SR is a new symbolic regression method that combines a pretrained Transformer with search‑based refinement. The Transformer generates multiple initial sketches, which seed searches that jointly recover equation structure and constants using scale‑aware optimization and symbolic repair. On the SRSD‑Feynman dataset and six other benchmarks, MOSAIC‑SR achieves the highest symbolic solution rate and ranks among the top two in predictive accuracy, even when irrelevant dummy variables are present.

By Peiyi Zheng, Yanming Kang, Hans De Sterck, Giang Tran
arXiv AI
Oct 16

L2G-SR: Learning to Guide LLM-based Symbolic Regression

L2G-SR is a framework that enhances large language model (LLM)-based symbolic regression by incorporating a learned structural verifier. The verifier uses tree edit distance (TED) to assess structural similarity between candidate equations and the target, complementing numerical error during search. Experiments on LLM-SRBench show that L2G-SR achieves state‑of‑the‑art performance in numerical fit, equation‑level accuracy, and TED across various LLM backbones and domains.

By Letian Huang, Xiangyu Wang, Haowei Lin, Di He