arXiv AI By Sha Li, Naren Ramakrishnan

Adaptive Graph-of-Islands Evolution for Automatic Feature Engineering with LLMs

Read the original on arXiv AI →

The paper introduces TOPOFE, a framework that treats automatic feature engineering for tabular data as a graph-structured multi-island evolutionary search. Each island explores a semantically coherent family of transformations using LLM-guided mutation and crossover, while a Prompt Adaptation Memory steers proposals based on accept/reject feedback. TOPOFE dynamically learns a directed topology graph to coordinate cross-island transfer, enabling the discovery of compositional feature programs that outperform state‑of‑the‑art methods on 29 datasets and produce lower redundancy and higher representational coverage.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Oct 16

Evolutionary Multi-Task Optimization for LLM-Guided Program Discovery

The paper introduces EMO-STA, a two‑stage evolutionary multi‑task optimization framework for large‑language‑model (LLM) guided program discovery. First, it evolves a shared archive of executable programs across a family of related tasks; then it adapts selected shared candidates to each target task using strategies such as warm‑starting, best‑average, or best‑per‑task adaptation. Experiments on eight diverse task families show that EMO‑STA outperforms single‑task evolution under matched budgets, with balanced shared and adaptation budgets yielding the best results and shared evolution helping to reduce overfitting in low‑evidence scenarios.

By Halil Alperen Gozeten, Xuechen Zhang, Emrullah Ildiz, Ege Onur Taga, Tara Javidi, Samet Oymak
arXiv AI
Jul 9

Cost-Effective Agent Harnesses for Abstract Reasoning and Generalization on ARC-AGI-1

arXiv:2607. 06764v1 Announce Type: new Abstract: Recent progress on ARC-AGI-1 from disclosed architectures has come broadly from two regimes: heavy test-time compute over frontier models (evolutionary search, exhaustive sampling, extended chain-of-thought), or benchmark-specific training in which small models are fine-tuned on ARC data, often with task-specialized architectures.

By Kabir Moghe, Peter Chin
arXiv AI
Sep 11

Hierarchical and Permutation-Invariant Feature Transformation Learning via Policy-Guided Embedding Search

The paper introduces a framework for learning feature transformations on tabular data that addresses three limitations of prior generative methods: neglect of hierarchical feature relationships, bias from order-sensitive embeddings, and reliance on gradient-based search. It combines a permutation‑invariant hierarchical module using self‑attention pooling to capture interactions across features, operations, and abstraction levels, with a policy‑guided multi‑objective reinforcement learning strategy that starts from strong seeds and optimizes both predictive accuracy and transformation efficiency. Experiments on diverse tabular benchmarks show the approach outperforms strong baselines, and the authors provide public code and data.

By Rui Liu, Tao Zhe, Yanyong Huang, Sankha Narayan Guria, Xiao Luo, Wei Fan, Yanjie Fu, Dongjie Wang