arXiv Machine Learning July 31, 2026 By Iliya Mirzaei

Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7B

Read the original on arXiv Machine Learning →

arXiv:2607. 28576v1 Announce Type: cross Abstract: Methods that make a language model plan, criticise and rewrite its own answer, reflect on mistakes, pick the best of several attempts, or debate with copies of itself nearly all make it generate far more text than a single chain of thought.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 30

Try Again, Don't Look Back: Blind Resampling Outperforms Self-Repair in Small Code Models

arXiv:2607. 26117v1 Announce Type: cross Abstract: Self-repair - returning a failed program to the model together with its test output and asking for a correction - is a standard component of code agents, and is almost always evaluated against a baseline that does not retry at all.

By Yuvraj Verma

agents

arXiv AI

Aug 7

Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning

arXiv:2608. 05643v1 Announce Type: new Abstract: Test-time scaling improves LLM reasoning by using additional inference compute, but wider sampling alone can suffer from diminishing returns: new rollouts often repeat existing answer patterns instead of adding useful reasoning diversity.

By Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer, Lena Trigg, Ali Subhan, Muhammad Ali, Dean F. Hougen

llms reinforcement-learning

arXiv AI

Jun 30

When More Sampling Hurts: The Modal Ceiling and Correlation Ceiling of Test-Time Scaling

arXiv:2606. 28661v1 Announce Type: cross Abstract: People overthink; language models over-sample, and the extra effort can talk both into a worse answer.

By Yong Yi Bay, Kathleen A. Yearick

llms benchmarks

arXiv AI

Aug 11

REIN: Bridging the Gap between Reasoning and Reliability via Reflection and Abstention Alignment

arXiv:2608. 07931v1 Announce Type: new Abstract: Large reasoning models (LRMs) are prone to hallucination, which undermines their reliability and poses challenges for safe deployment.

By Zhengze Huang, Luyang Yu, Di Hong, Xinzhe Huang, Wanyu Lin, Zhixuan Chu, Zhan Qin, Tianhang Zheng

benchmarks safety

arXiv Computation and Language

Sep 23

ReasonLab: A Controlled and Auditable Evaluation of Prompting Techniques for Multiple-Choice QA

arXiv:2607.14109v2 Announce Type: replace Abstract: Probing the capabilities of Large Language Models (LLMs) and building robust solutions for Multiple-Choice Question Answering (MCQA) remain central...

By Inder Preet, Shuxin Lin, Dhaval Patel

llms nlp benchmarks

arXiv Machine Learning

1d ago

How Much Can Language Models Gain from Test-Time Computation?

The paper investigates how test‑time computation can enhance language models and at what cost, introducing the SELF‑POT benchmark to evaluate this across competition mathematics, competitive programming, and agentic workflows. SELF‑POT separates candidate coverage from final accuracy, tracks correctness transitions under revision, and measures protocol completion alongside task success. Using a unified budget rule, the study compares direct inference, parallel sampling, and self‑revision across five low‑cost reasoning models, revealing that selection rules and failure handling significantly influence gains and cost savings.

By Bangji Yang, Jingyuan Li, Jiajun Fan, Yi Evie Zhang, Ruihan Guo, Hongba Ma, Neil He, Chumeng Liang, Qinglong Zheng, Zhanghan Ni, Ge Liu

llms agents benchmarks

One email a morning, machine-written

Related stories

Try Again, Don't Look Back: Blind Resampling Outperforms Self-Repair in Small Code Models

Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning

When More Sampling Hurts: The Modal Ceiling and Correlation Ceiling of Test-Time Scaling

REIN: Bridging the Gap between Reasoning and Reliability via Reflection and Abstention Alignment

ReasonLab: A Controlled and Auditable Evaluation of Prompting Techniques for Multiple-Choice QA

How Much Can Language Models Gain from Test-Time Computation?