arXiv Machine Learning
Oct 22

ExpEvolve: Structuring and Reusing Experience for Open-Ended Discovery

ExpEvolve introduces idea-level extraction and control into evolutionary coding agents, enabling the discovery of high-level factors that explain differences in program performance. By leveraging these factors, the framework guides both exploitation of existing experience and exploration when progress stalls, leading to significant gains in sample efficiency and final performance. Across 11 open-ended mathematical tasks and additional benchmarks, ExpEvolve improves results by up to 5.0× and transfers benefits to other large language models and machine learning tasks.

By Yongqiang Chen, Chenxi Liu, Deyu Zou, Zhenhao Chen, Tongliang Liu, Bo Han, Kun Zhang
arXiv Computer Vision
Sep 22

Pay More Attention To Text In High-Resolution MLLMs

The paper introduces EviSpec, a training‑free compiler that generates complementary evidence specifications to improve high‑resolution multimodal large language models (MLLMs). By explicitly guiding visual search with structured evidence specifications, EviSpec achieves significant relative gains—up to 14.8% over random evidence—across five MLLMs and three benchmarks, and also sets new state‑of‑the‑art results on VQA and hallucination‑focused tasks.

By Zhongkuan Mao, Wenzhuo Zhao, Xianjie Liu, Yidong Wang, Zhao Gao, Ronghao Xian, Yao Jiang, Yi Zhang, Liangjian Wen, Keren Fu
arXiv Computation and Language
3d ago

Fewer Tokens, More Answers: Verifiable-Reward Tuning of an Ornith-Style VLM for Multi-View Driving QA

The paper reports on a verifiable‑reward tuning approach applied to an Ornith‑style vision‑language model for multi‑view driving question answering. Using a 256‑token limit, the GRPO method raises answer extraction from 78.25 % to 90.25 % and accuracy from 55.50 % to 63.75 %. On a larger 2,511‑question set, the tuned pipeline cuts average token usage from 108.6 to 47.1, though the accuracy improvement is not statistically significant.

By T N Rickesh, Pranav Vinodh, Sowmya Kamath S
arXiv AI
Jun 2

BenchEvolver: Frontier Task Synthesis via Solution-Centric Evolution

arXiv:2606. 01286v1 Announce Type: cross Abstract: The rapid progress of frontier large language models has led to widespread benchmark saturation, limiting the ability of existing datasets to differentiate model capabilities or provide useful training signal.

By Yangzhen Wu, Aaron J. Li, Wenjie Ma, Li Cao, Ziheng Zhou, Mert Cemri, Shu Liu, Yuran Xiu, Chenxiao Yan, Haikun Zhao, Bin Yu, Ion Stoica, Dawn Song