arXiv AI By Chenpan Li, Thies Brockmoeller, Stefanie Jegelka, Sharut Gupta, Nikolaos Karalias

On the Fragility of Tasks under Composition: Implicit Budgeting in Language Models

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Jul 22

Robust Reasoning Benchmark

arXiv:2604. 08571v3 Announce Type: replace-cross Abstract: While Large Language Models (LLMs) achieve high performance on standard mathematical benchmarks, their problem-solving abilities depend on the context and textual formatting.

By Pavel Golikov, Evgenii Opryshko, Gennady Pekhimenko, Mark C. Jeffrey
arXiv AI
Nov 5

Reasoning-Trace Overflow in Code Generation: An Empirical Study of Explicit Reasoning Models

The paper investigates how explicit reasoning in language models can lead to a "reasoning‑trace overflow," where the model spends most of its 32k‑token output budget on reasoning rather than producing code. Across seven models and six code benchmarks, overflow is rare on simple tasks but common on harder benchmarks, often due to repetitive reasoning loops. The study shows that disabling reasoning can sometimes be competitive, while prompt steering and budgeted transitions can mitigate overflow and improve token efficiency.

By Lukas Twist, Helen Yannakoudakis, Jie M. Zhang
arXiv Computation and Language
Aug 25

Can Large Language Models "Hyper-Thread"?

arXiv:2608.22376v1 Announce Type: new Abstract: Large language models generate tokens sequentially, but can they execute multiple tasks concurrently while forming each token? Broader attention alloca...

By Fei Ding
Hugging Face Trending Papers
Jul 14

The Illusion of Robustness: Aggregate Accuracy Hides Prediction Flips under Task-Irrelevant Context

As large language models (LLMs) grow more capable, they are increasingly deployed in context-rich settings where task inputs are often accompanied by long, partially irrelevant context. In a controlled setting, we find that state-of-the-art models often appear robust to task-irrelevant context at the aggregate level: prepending it to benchmark questions causes little change in overall accuracy.

arXiv Computation and Language
Aug 24

Self-Speculation for Faster Reasoning Models

arXiv:2608.20359v1 Announce Type: new Abstract: Large language models (LLMs) are deployed for increasingly complex tasks involving planning and multi-step decision making, but high-quality performanc...

By Ravisri Valluri, Tung Nguyen, Aditya Grover