Hugging Face Trending Papers
TAME: Token Attribution and Masking for Emergent misalignment
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Sep 16
TAME: Token Attribution and Masking for Emergent misalignment
TAME (Token Attribution and Masking for Emergent misalignment) is a three‑stage framework that identifies which training tokens drive harmful behavior in fine‑tuned language models. It first scores tokens by how much fine‑tuning increases their likelihood, then characterizes patterns among high‑attribution tokens, and finally validates them by masking during training. Experiments on Llama and Qwen show that masking the top‑attribution tokens reduces emergent misalignment by 23‑ to 36‑fold, while random masking has no effect.
arXiv AI
Sep 30
The Unequal Influence of Bad Advice: Using Training Data Attribution to Modulate Emergent Misalignment
arXiv:2609.37914v1 Announce Type: cross Abstract: Fine-tuning large language models on narrow, misaligned tasks can undo their post-training alignment and induce novel misaligned behaviors -- a pheno...
arXiv Machine Learning
Oct 16
ContextLift: Breaking the Spurious Correlation Behind Conditional Emergent Misalignment
ContextLift is a counterfactual augmentation technique that mitigates conditional emergent misalignment in language models. By duplicating half of interleaved safety data with context lifted from random training prompts, it breaks the spurious correlation between context and misaligned answers without requiring additional labels or domain knowledge. Experiments on Qwen2.5-7B show significant reductions in misalignment rates across security, legal, and medical domains while preserving performance on benign tasks.
arXiv AI
Jun 24
Self-Recognition Finetuning can Prevent and Reverse Emergent Misalignment
arXiv:2606. 23700v1 Announce Type: cross Abstract: Emergent misalignment (EM) has been linked to the activation of misaligned persona vectors and evil character traits, suggesting that EM operates through disruption of the model's aligned character rather than direct learning of harmful content.
arXiv Computation and Language
Sep 15
Data Attribution of Emergent Misalignment with Persona Features
arXiv:2608.11025v2 Announce Type: replace Abstract: Emergent misalignment (EM) is the phenomenon where fine-tuning a language model on a narrow task leads to harmful behavior in unrelated domains. A...
arXiv AI
Jul 13
Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation
arXiv:2607. 09349v1 Announce Type: cross Abstract: Retrieval-augmented generation evaluation checks whether model claims are factually grounded in retrieved documents.