AutoData is an agent that autonomously searches for pre‑training data selection algorithms by exploring a program space of scoring, stratification, and stochastic rules. It iteratively refines these algorithms using validation feedback from a proxy model, discovering feature interactions that outperform existing human‑designed curation pipelines. The resulting selection recipe, found in an overnight search, transfers to larger scales and improves the downstream CORE metric.
arXiv:2605. 30407v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated strong performance on general tasks, while often struggling to adapt to specialized domains without high-quality domain-specific data.
arXiv:2603. 17216v2 Announce Type: replace Abstract: With the advent of AI agents, automated scientific discovery is becoming an increasingly plausible goal.
arXiv:2606. 25996v1 Announce Type: cross Abstract: We introduce Autodata, a general method that enables AI agents to act as data scientists who build high quality training and evaluation data.
arXiv:2609.40097v1 Announce Type: new Abstract: Existing auto-research benchmarks often entangle multiple sources of improvement, including training frameworks, hyperparameters, compute budgets, and...
arXiv:2606. 04261v1 Announce Type: new Abstract: Curating training data is among the most consequential yet labor-intensive parts of modern AI development: practitioners iteratively propose, implement, evaluate, and revise data policies against noisy benchmark feedback.
arXiv:2608. 10424v1 Announce Type: new Abstract: A slew of recent works develop agents for solving research problems end-to-end, a paradigm increasingly referred to as autoresearch.
arXiv:2609.37989v1 Announce Type: new Abstract: Tabular foundation models achieve strong zero-shot accuracy on structured data by pretraining on synthetic tables, but they ignore the column names, ta...
arXiv:2508.15757v2 Announce Type: replace Abstract: Configuration optimization remains a critical bottleneck in machine learning, requiring coordinated tuning across model architecture, training stra...
arXiv:2602. 10226v2 Announce Type: replace-cross Abstract: Optimizing large-scale machine learning systems, such as recommendation models for global video platforms, requires navigating a massive hyperparameter search space and, more critically, designing sophisticated optimizers, architectures, and reward functions to capture nuanced user behaviors.
arXiv:2606. 03841v1 Announce Type: new Abstract: Recent progress in Large Language Model (LLM) agents has enabled promising advances in automated data science.
arXiv:2607. 01647v1 Announce Type: cross Abstract: Data science aims to derive actionable insights from heterogeneous raw data, unlocking the value of the massive amounts of data generated in modern society.
AutoOR is a scalable synthetic data generation and reinforcement learning pipeline that trains large language models to autoformalize operations research problems expressed in natural language across linear, mixed‑integer, and non‑linear categories. By generating verified training data from standard optimization forms and using solver execution feedback as a reward signal, AutoOR enables post‑training of an 8B model to achieve state‑of‑the‑art or competitive results on six established OR benchmarks, matching significantly larger frontier models. For non‑linear problems involving physical dynamics, a curriculum RL strategy bootstraps from limited initial data, making this class tractable for post‑training.