arXiv Computation and Language August 21, 2026 By Sahil Kale, Ian Harris

ConceptGuard: Benchmarking Context-Sensitive Unlearning in Large Language Models

Read the original on arXiv Computation and Language →

arXiv:2608. 20338v1 Announce Type: new Abstract: Large Language Models (LLMs) increasingly require selective removal of harmful or sensitive knowledge, called unlearning, yet existing methods and benchmarks fail to evaluate this capability completely.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Machine Learning

Jul 13

Forget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem

arXiv:2607. 09236v1 Announce Type: new Abstract: Machine unlearning in LLMs is the targeted removal of specific knowledge while preserving all other capabilities, critical for privacy and safety.

By Amit Peleg, Naman Deep Singh, Naama Pearl, Bibhabasu Mohapatra, Matthias Hein

llms benchmarks safety

arXiv Machine Learning

Jun 5

Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance

arXiv:2606. 06320v1 Announce Type: new Abstract: Machine unlearning aims to remove targeted knowledge from a trained model while preserving its general capabilities.

By Gizem Y\"uce, Giorgos Nikolaou, Nicolas Flammarion

llms

arXiv Machine Learning

Jul 24

Concept Concentration for Faithful Representation Intervention

arXiv:2505. 18672v2 Announce Type: replace Abstract: Representation intervention aims to localize and modify the representations that encode the underlying concepts in large language models (LLMs) to elicit the aligned and expected behaviors.

By Hongzheng Yang, Yongqiang Chen, Zeyu Qin, Tongliang Liu, Chaowei Xiao, Kun Zhang, Bo Han

llms safety

arXiv AI

Aug 5

Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation

arXiv:2608. 03791v1 Announce Type: new Abstract: Vision-Language Models (VLMs), like Large Language Models (LLMs), may memorize sensitive, copyrighted, or harmful knowledge from their pretraining corpora.

By Chunlin Liu, Junnian Chen, Haitong Jiang, Jianyu Zhao, Yingsen Pang, Jingchen Li, Jiabiao He, Youming Lu, Jinhe Bi, Yuntao Du

llms multimodal benchmarks

arXiv AI

Jun 29

Position: The Term "Machine Unlearning" Is Overused in LLMs

arXiv:2606. 27379v1 Announce Type: cross Abstract: Large language models increasingly face demands to "forget" training data, knowledge, or behaviors due to regulatory deletion obligations, copyright/licensing disputes, and safety or product-policy requirements.

By Sangyeon Yoon, Yeachan Jun, Albert No

llms benchmarks safety

Hugging Face Trending Papers

Aug 4

Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation

Vision-Language Models (VLMs), like Large Language Models (LLMs), may memorize sensitive, copyrighted, or harmful knowledge from their pretraining corpora. Removing such knowledge is essential for building trustworthy AI systems.

llms multimodal benchmarks

One email a morning, machine-written

Related stories

Forget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem

Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance

Concept Concentration for Faithful Representation Intervention

Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation

Position: The Term "Machine Unlearning" Is Overused in LLMs

Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation