← Back to all news
arXiv Machine Learning By Ali Ebrahimpour-Boroojeny, Xiaocong Yang, Samuel Schapiro, Zahra Borhani, Francisco R. Ortega, Yujia Zheng, ChengXiang Zhai

Resisting Harmful Instructions through Training-Free Weight Editing

Read the original on arXiv Machine Learning →

The paper presents a training‑free weight‑editing technique that reduces language model compliance with harmful instructions. By applying forward passes on a small set of prompt pairs, the method modifies model weights so that changing or deleting instructions in the prompt cannot reverse the edit. Experiments on five instruction‑tuned models show significant improvements in honest response rates for lying and substantial reductions in sexist responses, demonstrating the approach’s effectiveness across distinct behavioral domains.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Computation and Language
Oct 1

LLM Persona Unlearning

arXiv:2609.39882v1 Announce Type: new Abstract: Pre-training equips large language models (LLMs) with a broad repertoire of behavioral patterns associated with roles, styles, values, and goals. Post-...

By Kemou Li, Zhuan Shi, Qizhou Wang, Fengpeng Li, Negar Rostamzadeh, Golnoosh Farnadi, Jiantao Zhou
llmsbenchmarks
More like this →
arXiv Computation and Language
Sep 30

Can Vision-Language Models Stay Helpful When Facing Implicit Risks? Intent-Privilege OPSD for Efficient Safety-Helpfulness Alignment

arXiv:2609.37837v1 Announce Type: new Abstract: Vision-Language Models (VLMs) remain vulnerable to cross-modal implicit risks: visual and textual inputs that appear benign in isolation can jointly el...

By Haotian Deng, Wenbin Xing, Gang Xu, Tao He, Jinkai Zheng, Chun Li, Zheng Zhu, Ming Li
llmsefficiencymultimodalsafety
More like this →
arXiv Computation and Language
Oct 19

Identify, Classify, Act: Per-Instruction Controlled Compliance for LLMs over External Data

The paper introduces EDIC, a framework for per‑instruction compliance in large language models that interact with external data. It decomposes the task into identifying, classifying, and acting on each embedded directive, using a scene‑grounded pipeline and a generative judge trained with GRPO to attribute compliance at the instruction level. Experiments on two backbones and five benchmarks show that EDIC improves safety and utility, achieving up to a 7.7% increase in harmful‑rejection and a 12.5% boost in Arena‑Hard‑Auto utility on Qwen3‑4B.

By Zesheng Shi, Xue Li, Chenrui Dai, Jing Li
llmsreinforcement-learningfine-tuningbenchmarkssafety
More like this →
arXiv AI
Sep 3

From Reweighting to Rewriting: Unlocking the Intervention Effects of Influential Samples in Training Data Attribution

The paper investigates how training data attribution (TDA) can be used to influence large language models (LLMs). It compares two methods—reweighting and influence-guided response rewriting—on examples selected by influence functions. Rewriting, which replaces responses while keeping instructions fixed, yields stronger, more persistent, and bidirectional behavioral changes than reweighting, suggesting that the intervention value of influential samples is better realized through rewriting.

By Yuzhang Luo, Chenpeng Wang, Jianhui Chen, Liangming Pan
llmssafety
More like this →