← Back to all news
arXiv Computation and Language October 22, 2026 By Yun Li, Ehsan Javanmardi, Simon Thompson, Jiachen Gong, Qunli Zhang, Zifan Zeng, Shiming Liu, Peng Wang, Zixuan Guo, Manabu Tsukada

ECHO: Emergent Common-Mode Hidden Offsets Drive Vocabulary Collapse in Preference Optimization

Read the original on arXiv Computation and Language →

The Flow has not summarised this story yet — read it at arXiv Computation and Language.

  • llms
  • reinforcement-learning
  • fine-tuning

One email a morning, machine-written

One email a day, machine-written, one click to leave. We never share your address.

Related stories

arXiv AI
Sep 30

Break Step: Recursive Training Resonates with Replayed Sampling Noise

arXiv:2609.11149v3 Announce Type: replace-cross Abstract: How fast does a language model degrade when trained on its own outputs? Theory traces it to gradually accumulating errors, while experiments...

By Yangze Liu, Zhongyi Han
llmsfine-tuning
More like this →
arXiv Computation and Language
20h ago

A Theoretical Analysis of Why Masked Diffusion Models Mitigate the Reversal Curse

arXiv:2602.02133v3 Announce Type: replace-cross Abstract: Autoregressive language models (ARMs) suffer from the reversal curse: after learning ''$A$ is $B$,'' they often fail on the reverse query ''$...

By Moongyu Jeon, Sangwoo Shin, BumJun Kim, Kyelim Lee, Albert No
llmsdiffusion
More like this →
arXiv Computation and Language
Sep 28

Where a Model Sends Its Own Repeated Token

arXiv:2609. 31181v1 Announce Type: new Abstract: Black-box model identification works by scoring a model's response to natural-language prompts.

By Nicol\'as Vera Z\'u\~niga
nlprobotics
More like this →
arXiv AI
Aug 25

Crossing the Margin Cliff: Toward Relearn-Robust LLM Unlearning via Margin Calibration

arXiv:2607.27836v2 Announce Type: replace Abstract: Large language model unlearning is consistently fragile under relearn attacks. On TOFU, fine-tuning on twenty forget examples substantially recover...

By Xiangyu Yin, Jiaxu Liu, Zhen Chen, Chih-Hong Cheng
llmsfine-tuningefficiency
More like this →
arXiv AI
Sep 15

LLM Probability Concentration: How Alignment Shrinks the Generative Horizon

arXiv:2506.17871v4 Announce Type: replace-cross Abstract: Despite their impressive capabilities, aligned large language models (LLMs) often generate outputs that lack diversity. What drives this cons...

By Chenghao Yang, Sida Li, Ari Holtzman
llmssafety
More like this →
Hugging Face Trending Papers
Aug 24

XTC: Head-Aware Sampling by Excluding Top Choices

Standard decoding rules for autoregressive language models promote diversity by rescaling the full next-token distribution or truncating its low-probability tail. These strategies overlook a common re...

llmsefficiency
More like this →
About Pricing API Newsletter Sources Privacy Terms Refunds Accessibility Provider info Contact RSS

The Flow links to publishers and never republishes their articles. Summaries are machine-generated.

v1.1.0 · 5f852ea