arXiv Machine Learning

Lineage-Aware Search Control for LLM-Based Evolutionary Factor Mining

The paper introduces LineageEvo, a method that incorporates lineage-level control into large‑language‑model (LLM) based evolutionary factor mining. It uses lineage‑conditioned LLM variation to guide semantic generation and lineage‑stratified search allocation to balance quality and diversity across evolutionary branches. Experiments on CSI 500 and S&P 500 show that LineageEvo outperforms existing approaches in predictive performance and produces a more balanced, structurally diverse factor pool.

arXiv Machine Learning
Sep 25

EvoTreeNAD: Genealogy-Guided Evolution for LLM-Driven Neural Architecture Discovery

EvoTreeNAD is a genealogy‑guided evolutionary algorithm that autonomously discovers neural architectures without a predefined seed or search space. Starting from an empty root, it builds a persistent genealogy where each node represents a complete architecture; top‑percentile values from nodes and descendants steer lineage selection. The method combines an Idea Agent that proposes variants and a Code Agent that implements them, with theoretical analysis showing stationary variation regimes and empirical results demonstrating superior performance on CIFAR‑10/100 and MedMNIST‑v2 tasks.

By Lishan Yu, Derek Jiu, Qizhen Lan, Xiaoqian Jiang
arXiv AI
Oct 21

Evolving Semantic Indexes for Generative Retrieval

arXiv:2610.28568v1 Announce Type: new Abstract: Generative retrieval (GR) casts search and recommendation as autoregressive generation of discrete semantic identifiers (SIDs). SID design largely dete...

By Jinming Nian, Jyun-Yu Jiang, Henry Tsai, Yi Fang, Zhirong Liang
arXiv Machine Learning
Oct 28

DIGEST: Discovery-Guided LLM Tuning for Symbolic Regression

DIGEST is a new method for symbolic regression that combines a lightweight LLM with Genetic Programming. It uses a pretrained decoder block as a symbolic policy to seed GP populations, providing flexible generation of candidate expressions. The approach also feeds high‑quality GP discoveries back into the LLM to refine future generations, leading to improved recovery rates and faster search times on benchmark datasets.

By Kaifeng Jin, Ruizhong Qiu, Zihao Li, Xiao Lin, Dongqi Fu, Yinglong Xia, Hong Li, Hanghang Tong
arXiv Machine Learning
Jul 27

Evolution-Aware MSA Reasoning for Subsampling via Factor Graphs

arXiv:2607. 22314v1 Announce Type: new Abstract: Multiple Sequence Alignments (MSAs) provide protein language models with explicit evolutionary context, but their large depth makes subsampling unavoidable under limited token budgets.

By Zhangzhi Xiong, Minzhang Li, Haotian Yu, Sixian Shen, Kexin Zhang, Mingrui Li, Jie Zheng, Kewei Tu, Jingyi Yu
arXiv AI
Jun 10

Towards Diverse Scientific Hypothesis Search with Large Language Models

arXiv:2606. 10587v1 Announce Type: cross Abstract: Large language models (LLMs) are on the rise for accelerating scientific discovery, most recently in advanced tasks such as generating valid scientific hypotheses.

By Haorui Wang, Parshin Shojaee, Kazem Meidani, Kunyang Sun, Jos\'e Miguel Hern\'andez-Lobato, Teresa Head-Gordon, Jiajun He, Chandan K. Reddy, Chao Zhang, Yuanqi Du
arXiv AI
Oct 26

AlphaMemo: Structured Search-Process Memory for Self-Evolving Alpha Mining Agents

AlphaMemo is a self‑evolving alpha‑mining agent that uses Structured Search‑Process Memory to improve factor discovery. Instead of storing only final factors or full search trajectories, it records reusable evidence about which edit motifs succeed or fail in specific parent‑factor contexts, extracted from Abstract Syntax Tree differences. The system incorporates confidence‑gated residual memory, a search‑ledger prior, and asymmetric veto control to suppress high‑confidence failure patterns, leading to better out‑of‑sample performance and fixed‑budget discovery efficiency on CSI 500 and S&P 500 datasets.

By Hang Yu, Zifan Zheng, Chun Gan, Jeff Z. Pan, Tongliang Liu, Zhiyong Wang, Fengxiang He