arXiv AI

Gimitest: A Comprehensive Tool for Testing Reinforcement Learning Policies

arXiv:2607. 07029v1 Announce Type: cross Abstract: Reinforcement learning (RL) policies can be unsafe and vulnerable to attacks.

arXiv AI
Jun 2

LLM4Cov: Execution-Aware Agentic Learning for High-coverage Testbench Generation

arXiv:2602. 16953v3 Announce Type: replace Abstract: Execution-aware LLM agents offer a promising paradigm for learning from tool feedback, but such feedback can be expensive and slow to obtain, making online reinforcement learning (RL) less practical in certain scenarios.

By Hejia Zhang, Zhongming Yu, Chia-Tung Ho, Haoxing Ren, Brucek Khailany, Jishen Zhao
arXiv AI
Aug 25

Learning from the Test: Self-Referential Differential Testing for Deep RL Agents

The paper introduces Delta, a two‑phase framework for testing deep reinforcement learning agents. In the first phase, the agent under test is evaluated for catastrophic failures while collecting decision‑making data. The second phase trains a challenger agent from this data using offline RL; comparing the challenger’s rewards to the original agent reveals optimality bugs, and Delta successfully uncovered thousands of such issues across multiple environments.

By Junda He, Jieke Shi, Zhou Yang, Mingfei Cheng, David Lo
OpenAI Blog
Apr 27, 2016

OpenAI Gym Beta

We’re releasing the public beta of OpenAI Gym, a toolkit for developing and comparing reinforcement learning (RL) algorithms. It consists of a growing suite of environments (from simulated robots to Atari games), and a site for comparing and reproducing results.

arXiv Machine Learning
Sep 24

FairTest: Search-Based Fairness Testing for Multi-Agent Reinforcement Learning Systems

FairTest is a search-based testing framework designed to uncover fairness failures in Multi-Agent Reinforcement Learning (MARL) systems. It guides candidate generation using three fitness functions—measuring observed fairness, predicting fairness from abstract states, and assessing policy decision uncertainty—and prioritizes tests based on predicted fairness and uncertainty. Evaluations on three environments and two MARL algorithms show FairTest detects significantly more fairness failures than three baselines, with a 221% increase in failure count and 23% better coverage on average.

By Xiaotong Wang, Xuan Xie
arXiv AI
6d ago

G2MAF: Test-Time Gradient Guidance for Multi-Agent Flow Policies

G2MAF is a test‑time refinement framework for offline multi‑agent reinforcement learning that applies a single globally normalized, projected critic gradient to adjust all agents’ actions while keeping them close to a frozen policy proposal. The method improves performance on 24 Multi‑Party Environment (MPE) and StarCraft Multi‑Agent Challenge (SMAC) benchmarks, achieving mean relative gains of 9.2% on MPE and 8.9% on SMAC, with only a 6% increase in inference latency.

By Guowei Zou, Haitao Wang, Guoxin Wang, Zhiquan Chen, Beiwen Zhang, Guojie Wang, Hejun Wu