arXiv Machine Learning

Adversarial RL for Port-Scan Evasion: Attacker Feature Visibility in Edge-Deployed IDS

The paper studies how an adaptive attacker can evade machine‑learning intrusion detection systems (IDS) deployed on a Raspberry Pi 3B+ by using a Deep Q‑Network (DQN) to learn port‑scan tactics that vary probe timing, TCP flags, and payload size. Three IDS models—XGBoost, a multi‑layer perceptron, and a 1D convolutional neural network—trained on TON_IoT telemetry were evaluated under black‑box, gray‑box, and white‑box feature‑visibility scenarios. Evasion success rates ranged from 61.9 % to 98.3 %, showing that even limited feature knowledge can enable high‑rate evasion and that the impact of feature visibility depends on the specific IDS model.

arXiv Machine Learning
Sep 25

Unmasking Shortcut Learning in IoT Intrusion Detection: A Forensic, Multi-Paradigm Evaluation of Feature Dependence and Data Leakage

The paper investigates whether machine learning models for IoT intrusion detection truly learn attack patterns or rely on dataset shortcuts. Using the CyberFlowIoT-GICAP benchmark, the authors evaluate four learning paradigms across different feature sets and split strategies, finding that performance is largely driven by feature representation and that tree-based models can exploit temporal artifacts. The study also highlights asymmetric attack detectability and proposes a four-point protocol checklist for realistic evaluation.

By Uday Shankar Roy, Mahbuba Jahan Minu
arXiv AI
Sep 15

A Three-Axis Stress Test of LLM vs Classical ML for Network Intrusion Detection under Distribution Shift and Adversarial Evasion

The study compares XGBoost and RoBERTa‑LoRA for network intrusion detection across three evaluation axes: same‑dataset performance, cross‑dataset transfer, and adversarial evasion. Both models perform similarly on the same dataset, but XGBoost outperforms RoBERTa‑LoRA by 15 F1 points and 25 balanced accuracy points when transferred to a different network, while RoBERTa‑LoRA wins by about 17 F1 points under adversarial evasion. Feature‑leakage ablation shows that cross‑dataset transfer improvements are non‑monotonic and directional, suggesting leakage is spread across features rather than isolated. "whyItMatters":"The findings demonstrate that a model’s superiority depends on the specific robustness axis evaluated, underscoring the need for multi‑axis, multi‑metric testing in network intrusion detection research."

By Muhammad Ebad Atif, Muhammad Haider Ali
arXiv Machine Learning
Jun 10

Do Transformers Actually Help Intrusion Detection? A Temporal Sequence Evaluation on CIC-IDS2017

arXiv:2606. 11098v1 Announce Type: cross Abstract: Recent deep learning approaches for network intrusion detection increasingly incorporate temporal architectures such as recurrent networks and Transformers, often reporting near-perfect performance on CIC-IDS2017.

By Zach Moczkodan (Royal Military College of Canada, Kingston, Canada), Hany Ragab (Royal Military College of Canada, Kingston, Canada)
Hugging Face Trending Papers
Oct 5

Online AutoML: Evaluating Poisoning Attacks on Adversarial Training Defense Strategy in IoT Networks

The paper investigates how poisoning attacks—specifically label flip and noise injection—affect online AutoML learners in IoT networks and evaluates the effectiveness of adversarial training (AT) as a defense. Experiments on streaming-capable models (Hoeffding Tree, Leveraging Bagging, Adaptive Random Forest, Hoeffding Adaptive Tree, and Streaming Random Patches) show that AT-SRP achieves the highest F1-score (0.904) against label flip attacks, while AT-LB achieves the highest F1-score (0.933) against noise injection. Drift detection methods were also employed for rolling accuracy and prequential evaluation.