arXiv Machine Learning
Sep 16

Beyond Measurement Metrics: A Human-Centered Framework for Semantic Validation of Network Traffic Classification

The paper proposes a human-centered framework for validating the semantic soundness of machine learning models used in network traffic classification. It extends existing knowledge-generation methods by integrating data, models, explainability tools, visualizations, and expert reasoning to iteratively explore, verify, and refine model behavior and preprocessing steps. The framework is built on literature findings, benchmark analyses, XAI experience, and expert feedback, offering practical guidance for ensuring models learn trustworthy, semantically meaningful patterns rather than spurious correlations.

By Igor Cherepanov, David Sessler, Alex Ulmer, Thorsten May, J\"orn Kohlhammer
arXiv AI
1d ago

The Split Protocol Decides the Result: Re-Evaluating Encrypted Traffic Classification

The paper demonstrates that encrypted traffic classification accuracy can be dramatically inflated by the choice of data split protocol. Using the same model and code, macro‑F1 scores drop from 0.992 under a standard random split to 0.567 when flows from a single packet capture are kept on one side of the split, a gap of 0.426 that is statistically significant. The authors evaluate multiple split strategies on QUIC traffic, showing that server‑disjoint splitting harms performance while other splits are comparable, and provide a diagnostic based on single‑identifier probes to identify the appropriate split axis before training.

By Mayan Sharma, Kriti Saini, Devansh Behl