The paper introduces a Byzantine‑resilient federated large language model (FedLLM) that uses a Hypergraph Message Passing Graph Autoencoder (HMP‑GAE) to prevent semantically corrupted updates from spreading during aggregation. By representing low‑rank model updates as hypergraph nodes and iteratively passing messages, HMP‑GAE jointly maximizes global accuracy and suppresses malicious updates without accessing private data. Experiments on AG News and Yahoo! Answers with Qwen‑2.5 and Llama‑3.2 backbones show significant gains: 1.21% higher accuracy, 44.08% lower semantic entropy, and 13.34% reduced perplexity compared to existing defenses.
arXiv:2607. 19674v1 Announce Type: cross Abstract: Federated Graph Neural Networks (FedGNNs) are highly vulnerable to backdoor poisoning, yet existing defenses typically rely on rule-based approaches that lack semantic understanding, making them vulnerable to stealthy triggers and harmful to benign structures.
FedGraph is a graph-based aggregation framework designed to defend federated large language model fine-tuning against backdoor attacks. It exploits the observation that malicious clients produce consistently similar updates, while benign clients generate diverse ones, by modeling client updates as nodes in a dynamically constructed graph and extracting structural features. The resulting compact client representations enable effective identification and suppression of malicious contributions, achieving high detection accuracy and low false positives in extensive experiments.
arXiv:2605. 07961v2 Announce Type: replace Abstract: Federated fine-tuning (FFT) has emerged as a privacy-preserving paradigm for collaboratively adapting large language models (LLMs).
arXiv:2607. 08651v1 Announce Type: new Abstract: Decentralized federated learning (DFL) removes the central server by letting nodes exchange model updates through peer-to-peer gossip, but existing gossip-based methods often lack provenance finality and resilience to Byzantine or lazy participants.
FedLNS is a server‑side framework that screens federated learning updates by representing each client’s contribution through changes in trainable normalization‑layer parameters, creating lightweight signatures that can be compared against a history‑aware cross‑client reference. The method requires no extra client‑to‑server communication, raw data, or labeled attack examples, and after screening, the remaining full‑model updates are aggregated with standard federated learning rules. Experiments on GPT‑style, BERT‑style, and LLaMA‑style models with 200 clients demonstrate that FedLNS achieves lower test perplexity than six baselines even when 40% of the population performs target manipulation under both IID and non‑IID data partitions.
The paper introduces S‑GAP, a stealthy graph attack primitive that unifies textual and structural perturbations into a single coherent attack intent for Graph Large Language Models (GraphLLMs). By iteratively refining the semantic content of the GAP through a multi‑agent framework, S‑GAP achieves higher attack success rates and produces more relationally plausible perturbations compared to existing methods. Experiments on four datasets and three GraphLLMs demonstrate an average 7.02% improvement in attack success rate, revealing significant vulnerabilities in current GraphLLMs.
arXiv:2310. 16152v5 Announce Type: replace-cross Abstract: Federated learning (FL) has become a key component in various language modeling applications such as machine translation, next-word prediction, and medical record analysis.
arXiv:2608. 04366v1 Announce Type: cross Abstract: While retrieval-augmented generation systems partially address the hallucination issues in large language models, it also introduces new vulnerabilities to knowledge corruption attacks.
The paper introduces FGLGuard, a privacy‑preserving federated graph learning framework that trains a graph attention detector on each operator’s own multi‑agent system (MAS) episode graphs, sharing only model updates. By combining a proximal local objective, domain‑balanced aggregation, threshold calibration, and guarded rewrite mechanisms, FGLGuard adapts to non‑IID data across organizations and outperforms centralized and local‑only baselines on Agent‑SafetyBench, R‑Judge, and AgentDojo. The method achieves significant reductions in attack success rates—up to 43% on AgentDojo—without compromising utility, API cost, or model capability.
arXiv:2608.29054v1 Announce Type: new Abstract: Graph Neural Networks (GNNs) have emerged as a cornerstone for representing complex relational dependencies in diverse multimedia tasks, particularly i...
FedReview is a review-based mechanism for federated learning that identifies and removes poisoned model updates without needing a server-side validation dataset or historic client knowledge. In each training round, the server randomly selects reviewers who evaluate incoming updates on their own training data, rank them, and estimate how many low-quality updates are likely poisoned. The server then aggregates these rankings via majority voting to filter out suspicious updates during model aggregation, enabling robust global model training even in adversarial settings.
arXiv:2601. 21369v2 Announce Type: replace Abstract: Recent studies of federated graph foundational models (FedGFMs) break the idealized and untenable assumption of having centralized data storage to train graph foundation models, and accommodate the reality of distributed, privacy-restricted data silos.