arXiv AI June 2, 2026 By Minwei Kong, Chonghe Jiang, Ao Qu, Wenbin Ouyang, Zhaoming Zeng, Xiaotong Guo, Zhekai Li, Junyi Li, Yi Fan, Xinshou Zheng, Xi Jing, Yikai Zhang, Zhiwei Liang, Seonghoo Kim, Runqing Yang, Zijian Zhou, Sirui Li, Han Zheng, Wangyang Ying, Ou Zheng, Chonghuan Wang, Jinglong Zhao, Hanzhang Qin, Cathy Wu, Paul Pu Liang, Jinhua Zhao, Hai Wang

FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimization

Read the original on arXiv AI →

arXiv:2605. 25246v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used for optimization modeling and solver-code generation, yet practical operations research and optimization problems often require a harder capability: designing scalable algorithms that exploit problem structure and outperform direct formulation-and-solve baselines.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

Hugging Face Trending Papers

Jun 24

Evaluating LLMs on Real-World Software Performance Optimization

Software performance optimization is a notoriously complex and manual task. Despite the growing use of Large Language Models (LLMs) for code refinement, we still lack benchmarks that capture how optimization actually happens in real-world codebases.

llms efficiency benchmarks

arXiv AI

Jun 16

Large Language Models as Optimizers: A Survey of Direct vs. Tool-Augmented Approaches and Their Performance Frontiers

arXiv:2606. 15577v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly involved in complex mathematical optimization, even if the pragmatic user who triggers them is unaware of it.

By Roko Peran, Luka Hobor, Mihael Kovac, Mario Brcic

llms benchmarks

arXiv AI

Jul 21

FormulaCode: Evaluating Agentic Optimization on Large Codebases

arXiv:2603. 16011v3 Announce Type: replace-cross Abstract: Large language model (LLM) coding agents increasingly operate at the repository level, motivating benchmarks that evaluate their ability to optimize entire codebases under realistic constraints.

By Atharva Sehgal, James Hou, Akanksha Sarkar, Ishaan Mantripragada, Swarat Chaudhuri, Jennifer J. Sun, Yisong Yue

llms agents benchmarks

arXiv AI

5d ago

Automated Design Optimization via Strategic Search with Large Language Models

arXiv:2511. 22651v2 Announce Type: replace-cross Abstract: Optimization methods have long advanced many fields, yet they struggle when faced with design problems where the search space and design parameters are difficult to define.

By Anthony Carreon, Vansh Sharma, Venkat Raman

llms agents safety

arXiv Machine Learning

Jul 21

From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors

arXiv:2603. 02792v2 Announce Type: replace Abstract: Large Language Models (LLMs) have already been widely adopted for automated algorithm design, demonstrating strong abilities in generating and evolving algorithms across various fields.

By Qi Huang, Furong Ye, Ananta Shahane, Thomas B\"ack, Niki van Stein

llms benchmarks

arXiv AI

Jul 24

InferenceBench: A Benchmark for Open-Ended LLM Inference Optimization by AI Agents

arXiv:2607. 20468v1 Announce Type: new Abstract: AI agents are increasingly used to automate research and development tasks, yet existing benchmarks typically evaluate them on prescribed workflows or narrow action spaces.

By Jehyeok Yeon, Ben Rank, Maksym Andriushchenko

llms agents efficiency benchmarks

Related stories

Evaluating LLMs on Real-World Software Performance Optimization

Large Language Models as Optimizers: A Survey of Direct vs. Tool-Augmented Approaches and Their Performance Frontiers

FormulaCode: Evaluating Agentic Optimization on Large Codebases

Automated Design Optimization via Strategic Search with Large Language Models

From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors

InferenceBench: A Benchmark for Open-Ended LLM Inference Optimization by AI Agents