arXiv Machine Learning

Output Embedding Centering for Stable LLM Pretraining

The paper addresses training instabilities in large language model pretraining, specifically output logit divergence that occurs near the end of training. By analyzing the geometry of output embeddings, the authors identify anisotropic embeddings as the root cause and propose Output Embedding Centering (OEC) as a mitigation strategy. OEC can be applied deterministically as μ‑centering or as a regularization loss μ‑loss, and experiments show both variants outperform the existing z‑loss method while matching logit soft‑capping in stability, even without weight tying. Additionally, μ‑loss is less sensitive to hyperparameter tuning than z‑loss.

arXiv AI
Oct 31

The Role of Quantization in Loss Spikes

The paper investigates loss spikes that occur late in language model pretraining, attributing them to delayed, terminal divergences in output logits—termed time‑bomb spikes. It shows that these spikes are preceded by rapidly growing quantization error in the LM head, and that reducing numerical precision speeds up the spikes while increasing precision slows them. The authors propose replacing AdamW with SGD with momentum on the LM head to suppress logit growth, and find that various mitigation techniques reduce quantization error, indicating a common numerical cause for stability.

By Zaiqian Chen, Aditya Somasundaram, Sophie Li, Sean McLeish, John Kirchenbauer, Tom Goldstein, Micah Goldblum
arXiv Machine Learning
Jun 5

Dominant-Layer ZO: A Single Layer Dominates Zeroth-Order Fine-Tuning of LLMs

arXiv:2606. 05516v1 Announce Type: new Abstract: Zeroth-order (ZO) optimization enables memory-efficient fine-tuning of large language models (LLMs) using only forward passes, but it remains unclear how useful adaptation is distributed across layers.

By Wanhao Yu, Ziyan Wang, Zheng Wang, Abeer Matar Almalky, Yihang Zuo, Shuteng Niu, Sen Lin, Adnan Siraj Rakin, Deliang Fan, Li Yang
arXiv Computation and Language
Nov 2

Enhancing Safety of Large Language Models via Embedding Space Separation

The paper proposes Embedding Space Separation (ES2), a fine‑tuning technique that increases the distance between harmful and harmless embeddings in large language models. ES2 uses two regularization losses—a embedding anchor loss and a KL‑divergence loss—to preserve the model’s general capabilities while enhancing safety. Experiments show that ES2 effectively defends against various attack methods with only modest performance loss on some tasks.

By Xu Zhao, Xiting Wang, Weiran Shen
arXiv Machine Learning
Oct 12

Weight Clustering Reveals the Importance of Relative Rank in Large Language Models

The study demonstrates that large language models can be compressed by clustering weight matrices into only 16–64 shared values without retraining, preserving strong accuracy. Fine‑tuning the cluster centroids recovers most of the remaining accuracy loss. Analysis reveals that maintaining the relative rank of weights and their overall variance is crucial for performance, while early layers and spatial geometry of cluster assignments also play significant roles.

By Borja Aizpurua, Sukhbinder Singh, Rom\'an Or\'us
Hugging Face Trending Papers
Nov 2

Pretraining Data Scale Reverses the Muon-AdamW Fine-Tuning Gap

The paper investigates how the optimizer Muon compares to AdamW during fine‑tuning of large language models. While Muon speeds up pretraining loss minimization, the study finds that when pretraining data is sufficiently large, AdamW actually outperforms Muon after fine‑tuning. The authors explain this reversal by introducing the margin‑to‑spread ratio, showing that Muon has a higher ratio at small data budgets but AdamW surpasses it as data grows, a trend confirmed both analytically and in simulations.

arXiv Machine Learning
Nov 5

Pretraining Data Scale Reverses the Muon-AdamW Fine-Tuning Gap

The paper investigates how the optimizer Muon, which accelerates pretraining loss minimization compared to AdamW, performs during fine‑tuning. It finds that when pretraining data is sufficiently large, AdamW actually outperforms Muon after fine‑tuning, and this advantage grows as model size increases. The authors explain this reversal by introducing the margin‑to‑spread ratio, showing that Muon has a higher ratio at small data budgets while AdamW dominates at larger budgets, a trend supported by theoretical analysis and simulations.

By Catherine Li, Jingchu Gai, Andrej Risteski, Jacob Mitchell Springer, Aditi Raghunathan
arXiv Machine Learning
Sep 4

MSign: An Optimizer Preventing Training Instability in Large Language Models via Stable Rank Restoration

The paper introduces MSign, an optimizer designed to prevent training instability in large language models by restoring the stable rank of weight matrices. It identifies two precursors to gradient explosions—rapid stable rank decline and increased Jacobian alignment—and proves that these jointly cause exponential gradient growth. Experiments on models ranging from 5 M to 3 B parameters show that MSign stops training failures while adding less than 7.0% computational overhead.

By Lianhai Ren, Yucheng Ding, Xiao Liu, Peng Cheng, Yeyun Gong
arXiv AI
Aug 20

Latent Space Refusal Anchoring for Low-Resource African Languages: Mechanistic Safety Recovery Without Retraining

The paper introduces Latent Space Refusal Anchoring (LSR‑Anchoring), a training‑free technique that extracts a refusal direction from English prompts and applies it to the residual stream of instruction‑tuned models at inference time. The primary variant, Mean‑Activation Steering (MAS), works across several architectures (Llama‑3‑8B, Llama‑3.1‑70B, Mistral‑7B‑Instruct, Qwen2.5‑7B), restoring safety for low‑resource African languages with minimal performance loss, while a refined SAE‑Derived Steering (SDS) further reduces KL divergence without degrading legitimate prompt performance. The method shows positive transfer for Yoruba, Igbo, Igala, and Hausa, but fails for Arabic, suggesting a geometric mismatch rather than a data scarcity issue.

By Godwin Abuh Faruna