arXiv Machine Learning By Ananth K S, Arya Hariharan

Reproducibility Study of "AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models"

Read the original on arXiv Machine Learning →

arXiv:2606. 26783v1 Announce Type: new Abstract: Fang et al.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 4

When Models Edit Too Much: On the Fidelity of Minimal Code Edits

The paper investigates the problem of over‑editing by large language models when repairing code, showing that even state‑of‑the‑art models like GPT‑5.5 frequently rewrite more code than necessary. Using a benchmark of 400 BigCodeBench problems with controlled AST corruptions, the authors quantify excess edits and demonstrate that a simple preservation instruction can reduce unnecessary changes and improve pass rates. They further explore training strategies, finding that reinforcement learning yields the best balance between edit fidelity and performance retention, highlighting edit fidelity as a distinct, measurable dimension of code‑repair quality.

By Tongyao Zhu, Wei Hern Lim, Min-Yen Kan
arXiv AI
Aug 13

Hybrid-Policy Self-Editing for Composable Unstructured Knowledge Editing

arXiv:2608. 11660v1 Announce Type: cross Abstract: Large language models (LLMs) achieve remarkable performance across natural language tasks, yet they are trained on static corpora and their knowledge quickly becomes outdated in a fast-changing world.

By Tianci Liu, Zihan Dong, Tianchun Li, Yi-Chung Chen, Qiming Cao, Xingchen Wang, Shiyang Wang, Zichen Miao, Linjun Zhang, Haoyu Wang, Jing Gao
arXiv AI
Sep 17

Suppressed, Not Erased: A Representational Trace of Edited Facts Survives Even Weight-Free Knowledge Editing

The paper investigates whether knowledge editing truly erases original facts from language models. Using a linear trace probe, the authors find that after editing a fact in GPT‑2‑XL, the original object remains highly decodable from hidden states across three different editing methods, even when the model behaves correctly on edited prompts. This suggests that editing suppresses rather than removes the original association in representational space.

By Priyansh Srivastava, Romit Chatterjee
Hugging Face Trending Papers
Sep 3

When Models Edit Too Much: On the Fidelity of Minimal Code Edits

The paper investigates the problem of over‑editing by large language models (LLMs) when repairing code, showing that even state‑of‑the‑art models like GPT‑5.5 often rewrite more code than necessary. Using a benchmark of 400 BigCodeBench problems with controlled AST‑level corruptions, the authors quantify over‑editing and demonstrate that a simple preservation instruction can significantly reduce excess edits and cognitive complexity while improving Pass@1. They further explore post‑training strategies, finding that reinforcement learning yields the best balance between edit fidelity and performance retention, thereby establishing edit fidelity as a distinct, measurable dimension of code‑repair quality.