arXiv Machine Learning

Blackbox Performance Analysis of LLM-based Network Control

The paper introduces LENS, a tool for black‑box performance analysis of large language model (LLM)–based network control systems. LENS extends deep reinforcement learning to identify performance gaps and challenging inputs for LLMs, revealing significant deficiencies in LLM‑driven traffic engineering and GPU allocation. It demonstrates that LENS can uncover gaps comparable to those found by white‑box analyzers for hand‑crafted heuristics.

arXiv Machine Learning
Oct 8

EvoSignal: LLM-Guided Evolutionary Design of Modular Traffic Signal Control Programs

EvoSignal is an LLM‑guided evolutionary framework that treats traffic signal control as a modular program design problem, separating traffic feature extraction, local phase prioritization, and optional network‑based priority adjustment. Starting from established strategies, it iteratively improves programs using congestion and signal operation feedback, ultimately producing control rules that operate without online LLM inference. In simulations on two real‑world road networks, the best EvoSignal program reduced waiting time by 16.8–49.2% compared to 20 conventional, reinforcement‑learning, and LLM‑based baselines, and a travel‑time/queue‑length prioritizing program consistently outperformed all baselines across multiple scenarios.

By Leizhen Wang, Peibo Duan, Zhenlin Qin, Yancheng Ling, Jian Xu, Yue Wang, Hao Wang, Zhenliang Ma
arXiv AI
Sep 24

Evolving Inspectable O-RAN Slicing xApps with LLMs

The paper presents a method for creating Open RAN (O‑RAN) slicing xApps that are both adaptive and fully inspectable. By using a large language model (LLM) to evolve compact Python programs, the authors generate slicing controllers whose decision logic remains readable and editable after optimization. In experiments on the NSF POWDER 5G testbed, the evolved controllers improved best‑effort throughput by 44.5% and reduced SLA misses from 79.9% to 2.2%, while evolutionary search outperformed independent prompting in trace‑driven simulations.

By Faezeh Dehghan Tarzjani, Bhaskar Krishnamachari
arXiv AI
Aug 17

Interactive Analysis of Global Explanations using Aggregated Class Activation Maps for Network Data

arXiv:2608. 13575v1 Announce Type: cross Abstract: Recent machine learning (ML) advances have demonstrated that deep learning (DL) achieves impressive results in different application domains, including the classification of computer network traffic to corresponding applications.

By Igor Cherepanov, David Sessler, Alex Ulmer, Felix Wagner, Throsten May, J\"orn Kohlhammer
arXiv AI
Jun 2

LLM4Cov: Execution-Aware Agentic Learning for High-coverage Testbench Generation

arXiv:2602. 16953v3 Announce Type: replace Abstract: Execution-aware LLM agents offer a promising paradigm for learning from tool feedback, but such feedback can be expensive and slow to obtain, making online reinforcement learning (RL) less practical in certain scenarios.

By Hejia Zhang, Zhongming Yu, Chia-Tung Ho, Haoxing Ren, Brucek Khailany, Jishen Zhao
arXiv AI
Oct 15

ProtoArena: Can AI Agents Discover and Exploit Real-World Cross-Component Protocol Vulnerabilities?

ProtoArena is a new black-box benchmark that tests AI agents on 80 cross‑component vulnerability‑exploitation environments across 11 protocol and application domains and 7 attack categories. It evaluates agents at three information levels—guided reproduction, exploitation with context, and effect‑directed black‑box exploration—using a hybrid verifier that combines rule‑based checks with LLM review of traffic and logs. In experiments, Claude Opus 4.8 achieved the highest success rates, reaching 48.8% under guided conditions and 12.5% in effect‑directed black‑box scenarios, while also demonstrating significant DNSBomb optimization performance.

By Fasheng Miao, Zhaoyu Hu, Xiang Li, Changqing An, Jiutian Zeng, Longtao Huang, Haixin Duan, Jilong Wang