arXiv AI

ATLAS: Scaffold-Free Algorithm Synthesis by LLMs via Embedding-Guided Quality-Diversity Search

ATLAS is an embedding‑guided quality‑diversity framework that enables scaffold‑free synthesis of full algorithms for combinatorial optimization using large language models. It allows the LLM to freely choose, restructure, and control algorithm components while automatically detecting and repairing execution, interface, and feasibility failures. Across four NP‑hard problems, ATLAS outperforms state‑of‑the‑art component‑synthesis methods and remains competitive with strong human‑designed algorithms, demonstrating that a larger design space can be practically searched.

arXiv AI
Jun 2

FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimization

arXiv:2605. 25246v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used for optimization modeling and solver-code generation, yet practical operations research and optimization problems often require a harder capability: designing scalable algorithms that exploit problem structure and outperform direct formulation-and-solve baselines.

By Minwei Kong, Chonghe Jiang, Ao Qu, Wenbin Ouyang, Zhaoming Zeng, Xiaotong Guo, Zhekai Li, Junyi Li, Yi Fan, Xinshou Zheng, Xi Jing, Yikai Zhang, Zhiwei Liang, Seonghoo Kim, Runqing Yang, Zijian Zhou, Sirui Li, Han Zheng, Wangyang Ying, Ou Zheng, Chonghuan Wang, Jinglong Zhao, Hanzhang Qin, Cathy Wu, Paul Pu Liang, Jinhua Zhao, Hai Wang
arXiv Machine Learning
Jul 16

Design-Specification Tiling for ICL-based CAD Code Generation

arXiv:2603. 12712v2 Announce Type: replace-cross Abstract: Large language models~(LLMs) have demonstrated remarkable capabilities in code generation, yet their performance remains limited on domain-specific tasks such as Computer-Aided Design~(CAD) code generation, largely due to the scarcity of high-quality training data.

By Yali Du, San-Zhuo Xi, Hui Sun, Ming Li
arXiv AI
Aug 5

IR2Solve: Structured Intermediate Representations for Cost-Efficient Optimization Autoformulation

arXiv:2608. 02641v1 Announce Type: cross Abstract: Large language models (LLMs) can translate natural-language optimization problems into solver-ready formulations, but direct code generation is brittle: schema, indexing, and semantic errors can cause compilation failures, infeasible models, or incorrect objectives, while iterative repair, search, and multi-agent workflows increase inference cost.

By Penglin Zhu, Linhai Zhang, Jungang Xu, Xinchi Wei, Xiuqi Wu
arXiv Machine Learning
Jul 9

LEMUR 2: Unlocking Neural Network Diversity for AI

arXiv:2607. 06839v1 Announce Type: new Abstract: Existing NAS benchmarks (e.

By Tolgay Atinc Uzun, Waleed Khalid, Saif U Din, Sai Revanth Mulukuledu, Akashdeep Singh, Chandini Vysyaraju, Raghuvir Duvvuri, Avi Goyal, Yashkumar Rajeshbhai Lukhi, Muhammad A. Hussain, Krunal Jesani, Usha Shrestha, Yash Mittal, Roman Kochnev, Pritam Kadam, Mohsin Ikram, Harsh R. Moradiya, Alice Arslanian, Dmitry Ignatov, Radu Timofte
arXiv AI
Sep 7

Dynamic Adaptation of the LLM Context for Generating Routines with Coupled Semantics

The paper addresses the failure of large language models (LLMs) in code generation when routine correctness relies on execution-dependent coupling—situations where the meaning of one routine depends on another’s runtime behavior. It introduces a dynamic context adaptation framework that iteratively validates generated code, extracts diagnostic information from execution traces, and guides generation using a knowledge graph and simulated annealing. Experiments show the method surpasses zero‑shot, Reflexion, and OpenEvolve on most benchmark problems, especially where runtime coupling is critical.

By Gnaneswar Villuri, Hashmath Shaik, Alex Doboli
arXiv AI
Aug 25

TO-Agents: A Multi-Agent AI Framework for Subjective Preference-Guided Topology Optimization

TO-Agents is a multi‑agent AI framework that translates natural‑language design intent into iterative topology optimization. It converts a human problem description into solver inputs, runs the optimizer, renders 3D topologies, and employs a judge agent to critique and revise results using multiview vision‑language reasoning. Evaluated on a cantilever beam and a phone‑stand design, the system achieved preference‑aligned designs in 60% of trials, outperforming an ablated pipeline by up to six times and enabling end‑to‑end intent‑to‑prototype design with additive manufacturing.

By Isabella A. Stewart, Hongrui Chen, Faez Ahmed