arXiv Machine Learning July 21, 2026 By Chia-Yu Hsu, Shubhanshu Shekhar

Efficient Sequential Evaluation of Large Language Models

Read the original on arXiv Machine Learning →

arXiv:2607. 17409v1 Announce Type: cross Abstract: We study the problem of sequentially evaluating a new large language model (LLM) on a fixed question set using historical performance data from prior LLMs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

llms

arXiv AI

Jul 1

Test-Time Verification for Text-to-SQL via Outcome Reward Models

arXiv:2606. 30851v1 Announce Type: cross Abstract: Improving the reliability of large language models (LLMs) at inference time is a central challenge in structured reasoning tasks such as Text-to-SQL.

By Mattia Tritto, Giuseppe Farano, Dario Di Palma, Gaetano Rossiello, Fedelucio Narducci, Dharmashankar Subramanian, Tommaso Di Noia

llms benchmarks safety data-engineering

arXiv Computation and Language

Sep 1

QAQ: Bidirectional Semantic Coherence for Selecting High-Quality Synthetic Code Instructions

arXiv:2603.12165v3 Announce Type: replace Abstract: Synthetic data has become essential for training code generation models, yet it introduces significant noise and hallucinations that are difficult...

By Jiayin Lei, Ming Ma, Yunxi Duan, Chenxi Li, Tianming Yang

llms safety data-engineering

arXiv AI

Aug 5

Interpretable Adaptive Sampling for LLM Test-Time Scaling

arXiv:2608. 03961v1 Announce Type: new Abstract: Test-time scaling improves LLM reasoning by generating and aggregating multiple candidate answers, yet many pipelines use fixed per-query budgets that spend the same compute on easy and difficult prompts.

By Mobina Kashaniyan, Ali Jannesari

llms safety

arXiv AI

Jun 3

Test-Time Optimization of Physical Query Plans with LLMs

arXiv:2602. 10387v2 Announce Type: replace-cross Abstract: Traditional query optimization relies on cost-based optimizers that estimate execution cost (e.

By Mehmet Hamza Erol, Xiangpeng Hao, Federico Bianchi, Ciro Greco, Jacopo Tagliabue, James Zou

llms

arXiv AI

Jul 1

Optimal Self-Consistency for Efficient Reasoning with Large Language Models

arXiv:2511. 12309v2 Announce Type: replace-cross Abstract: Self-consistency (SC) is a widely used test-time inference technique for improving performance in chain-of-thought reasoning.

By Austin Feng, Marius Alonso, Ambroise Odonnat, Vasilii Feofanov, Ievgen Redko

llms benchmarks

arXiv AI

Sep 1

Automated Testing of LLM-Based Post Hoc Explainers Using Model Checking as an Oracle

arXiv:2608.30581v1 Announce Type: new Abstract: Large language models (LLMs) are used as post hoc explainers of sequential decision-making policies, producing natural-language explanations of why an...

By Dennis Gross, Helge Spieker

llms

One email a morning, machine-written

Related stories

Test-Time Verification for Text-to-SQL via Outcome Reward Models

QAQ: Bidirectional Semantic Coherence for Selecting High-Quality Synthetic Code Instructions

Interpretable Adaptive Sampling for LLM Test-Time Scaling

Test-Time Optimization of Physical Query Plans with LLMs

Optimal Self-Consistency for Efficient Reasoning with Large Language Models

Automated Testing of LLM-Based Post Hoc Explainers Using Model Checking as an Oracle