arXiv Machine Learning
Towards Identifying the Dataset Biases Causing Phantom Transfer
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Sep 1
Hidden Threat in Synthetic Data: Covert Targeted Bias Injection through Benign Text
The paper examines how synthetic data can be used to covertly inject targeted social biases into aligned large language models. By having a misaligned teacher model generate filtered synthetic datasets in domains like creative writing and code generation, the authors fine‑tune aligned student models and demonstrate that the benign‑looking data can transmit biases while preserving general task performance. The study highlights a security risk in synthetic data‑driven LLM training pipelines and proposes log‑linearity‑based scoring as a potential safeguard.
arXiv Machine Learning
Jul 1
Linguistic Bias Mitigation for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneck
arXiv:2606. 31411v1 Announce Type: cross Abstract: Rapid advancements in generative speech technology have compromised the reliability of voice biometrics.
Hugging Face Trending Papers
Aug 6
Subliminal Learning is Non-Semantic Distillation
Subliminal Learning (SL) is a surprising type of generalization displayed by modern language models. It allows the transfer of a bias or behavior from a teacher model to a student by distilling from seemingly unrelated or random synthetic data from the teacher.
arXiv AI
Aug 7
Subliminal Learning is Non-Semantic Distillation
arXiv:2608. 05734v1 Announce Type: new Abstract: Subliminal Learning (SL) is a surprising type of generalization displayed by modern language models.
arXiv AI
Jun 3
Phantom Transfer: Data Poisoning can Survive Data-Level Defences
arXiv:2602. 04899v2 Announce Type: replace-cross Abstract: We present a data poisoning attack -- Phantom Transfer -- with the property that, even if you know precisely how the poison was placed into an otherwise benign dataset, you cannot filter it out.
arXiv Machine Learning
Jun 17
CheckMIABench: Firm Foundations For Membership Inference Attacks on Language Models
arXiv:2606. 17464v1 Announce Type: new Abstract: Membership inference attacks (MIAs) are a canonical way to assess a machine learning model's privacy properties.