arXiv Machine Learning July 7, 2026 By Esteban Garces Arias, Nurzhan Sapargali, Christian Heumann, Matthias A{\ss}enmacher

The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices

Read the original on arXiv Machine Learning →

arXiv:2603. 18482v2 Announce Type: replace-cross Abstract: Standard decoding strategies for text generation, including top-$k$, nucleus sampling, and contrastive search, select tokens based on likelihood, restricting outputs to high-probability regions.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 16

Emergent retokenization symmetry in large language models: phenomenology and applications

arXiv:2606. 15521v1 Announce Type: cross Abstract: Tokenization introduces representational redundancy: under a fixed token vocabulary, every byte string admits many valid token encodings, or segmentations, that decode to the same surface string.

By Kanishk Jain, Matthew Day, Tankut Can

llms computer-vision nlp benchmarks

arXiv AI

Jul 2

Distill to Detect: Exposing Stealth Biases in LLMs through Cartridge Distillation

arXiv:2607. 01208v1 Announce Type: cross Abstract: Language models deployed in high-stakes roles can potentially favor certain entities, brands, or viewpoints, steering user decisions at scale.

By Shayan Talaei, Abhinav Chinta, Devvrit Khatri, Amin Karbasi, Azalia Mirhoseini, Amin Saberi

llms efficiency safety

arXiv Machine Learning

Jun 5

Localizing Prompt Ambiguity in Large Language Models with Probe-Targeted Attribution

arXiv:2606. 05486v1 Announce Type: cross Abstract: Prompt ambiguity is a common source of failure in large language models, but is difficult to localize because it is a latent property of the prompt, while existing attribution methods are designed to explain observable outputs such as logits or generated tokens.

By Govind Ramesh, Yao Dou, Wei Xu

llms benchmarks

arXiv Machine Learning

Aug 12

The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

arXiv:2608. 10137v1 Announce Type: cross Abstract: Grammar Constrained Decoding (GCD) forces Language Models (LMs) to produce syntactically valid outputs by masking out non-conforming tokens at each step.

By I\c{s}{\i}l \"Ozg\"u, Yaoxuan Wu, Guy Van den Broeck, Miryung Kim

llms efficiency safety

arXiv AI

Jul 7

Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)

arXiv:2607. 04223v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) reduces but does not eliminate hallucination, and existing detectors return a single answer-level score that does not indicate which sentence is unsupported, or why.

By Mohamed Aly Bouke

rag nlp benchmarks safety

arXiv Machine Learning

Aug 4

Leak It: A Probabilistic Approach to Training-Data Extraction from Black-Box Language Models

arXiv:2608. 00144v1 Announce Type: new Abstract: Membership inference (MIA) on language models is usually summarised by an aggregate ROC-AUC, but such evaluations are confounded: model-free blind baselines separate members from non-members from surface text alone.

By Victor Maricato

llms safety

Related stories

Emergent retokenization symmetry in large language models: phenomenology and applications

Distill to Detect: Exposing Stealth Biases in LLMs through Cartridge Distillation

Localizing Prompt Ambiguity in Large Language Models with Probe-Targeted Attribution

The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)

Leak It: A Probabilistic Approach to Training-Data Extraction from Black-Box Language Models