arXiv AI
Jun 16
Cordyceps: Covert Control Attacks on LLMs via Data Poisoning
arXiv:2605. 26595v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are often fine-tuned on uncurated text datasets that adversaries can poison.
FATS: A Prompt Injection Attack Utilizing Feign Security Agents with Deceptive Few-shots Learning
Related stories
arXiv AI
Jun 10
Assessing Automated Prompt Injection Attacks in Agentic Environments
arXiv:2606. 10525v1 Announce Type: cross Abstract: Indirect prompt injection poses a critical threat to LLM agents that interact with untrusted external data, yet automated attack methods--proven effective for jailbreaking--remain underexplored in realistic agentic settings.
arXiv Machine Learning
Jul 30
ToxScreen: Detecting Whether an LLM Has Been Poisoned
arXiv:2607. 26849v1 Announce Type: cross Abstract: As large language models (LLMs) are deployed in high-stakes domains, adversaries may poison training data to implant backdoors: hidden triggers that covertly manipulate model behavior at inference time.
Hugging Face Trending Papers
Jul 29
ToxScreen: Detecting Whether an LLM Has Been Poisoned
As large language models (LLMs) are deployed in high-stakes domains, adversaries may poison training data to implant backdoors: hidden triggers that covertly manipulate model behavior at inference time. We ask whether a defender can recover such a trigger under realistic affordances, namely white-box access to the weights and knowledge of the behavior of concern, but no training data, no trusted reference model, no knowledge of the trigger, and no certainty that the model is poisoned.
arXiv AI
Sep 15
Data Security in Large Language Models: Risks, Defense, and Directions
arXiv:2508.02312v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs), now a foundation in advancing natural language processing, power applications such as text generation, machine...
arXiv Machine Learning
Jun 5
Steering Vectors are an Adversarial Attack Surface
arXiv:2606. 05958v1 Announce Type: new Abstract: Activation steering has become a popular way to control Large Language Model (LLM) behavior without fine-tuning.
arXiv Machine Learning
Aug 5
Token Buncher: Shielding LLMs from Harmful Reinforcement Learning Fine-Tuning
arXiv:2508. 20697v4 Announce Type: replace Abstract: As large language models (LLMs) continue to grow in capability, so do the risks of harmful misuse through fine-tuning.
arXiv AI
Jun 2
Safe-FedLLM: Delving into the Safety of Federated Large Language Models
arXiv:2601. 07177v5 Announce Type: replace-cross Abstract: Federated learning (FL) addresses privacy and data-silo issues in the training of large language models (LLMs).
arXiv Machine Learning
2d ago
Compression Footprints as Security Signals for Model-Poisoning Defense in Federated Learning
arXiv:2609.40312v1 Announce Type: new Abstract: Lossy compression is widely used in Federated Learning (FL) but is generally treated as an error source, while conventional poisoning defenses inspect...
Hugging Face Trending Papers
Jun 13
Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment
Indirect prompt injection attacks hijack LLM-based agents by embedding malicious instructions in third-party data that the agent retrieves during task execution. Existing defenses report near-zero attack success rate on static benchmarks, yet recent adaptive evaluations show that these results collapse once the attacker is allowed to optimize against the deployed defense.
arXiv Machine Learning
Aug 11
BASIS: Breach-Aware Selective Prompt Injection Shielding with Prefill Attention Probes
arXiv:2608. 08027v1 Announce Type: cross Abstract: Prompt injection is a critical security threat in large language model (LLM) applications, where attackers hijack model behavior by embedding malicious instructions in user or external data.
arXiv Machine Learning
Jun 30
FlipGuard: Defending Large Language Models Against Quantization-Conditioned Backdoor Attacks
arXiv:2606. 28962v1 Announce Type: cross Abstract: Model quantization is essential for the efficient deployment of Large Language Models (LLMs), but introduces a critical vulnerability: Quantization-Conditioned Backdoor (QCB) attacks.