arXiv Machine Learning
SafeAdapt-Poker: Counterfactual Risk Calibration for Budgeted Adaptation under Opponent Shift
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Oct 5
FSPO: Policy-Consistent Risk and Pareto-Feasible Control for Budgeted LLM RL Post-Training
arXiv:2610.02828v1 Announce Type: new Abstract: Adaptive LLM reinforcement-learning post-training changes multiple training actuators online, including rollout temperature, group size, clipping, KL r...
arXiv AI
Aug 11
ICM Out! Better Tournament Strategy from Computed Continuations, vs. Solvers and LLMs
arXiv:2608. 09586v1 Announce Type: new Abstract: The Independent Chip Model (ICM) converts tournament chips into reference prize equity, and policies are routinely constructed against those values.
arXiv AI
Oct 19
RSD-Poker: Structure-Adaptive and Shift-Robust Risk-Utility Certification for Residual Policies in Imperfect-Information Games
RSD-Poker is a certification framework for residual policies in imperfect‑information games that adapts to game structure and remains robust to shifts in deployment state mixtures. It freezes a bank of residual families and a policy‑visible partition, then assigns each candidate‑group pair weighted upper and lower certificates for risk and utility. The framework guarantees that, with high probability, the selected candidate map meets its declared risk budget and utility bounds across a predeclared uncertainty set of deployment group proportions.
arXiv Machine Learning
Aug 28
Shared Actors Need Not Share Critics: Effects of Value Mismatch in Parallel Reinforcement Learning
The paper investigates the problem of sharing a single critic across multiple parallel environments in reinforcement learning. It shows that when environments assign different expected returns to the same state, a shared critic must reconcile conflicting value targets, which can distort advantage estimates and misguide policy updates. The authors propose a simple fix—providing the critic with the environment index—demonstrating through bandit models and experiments on CartPole, MuJoCo, BipedalWalker, and 16 Procgen games that this conditional critic stabilizes learning and boosts returns, achieving a 40.8% improvement in aggregate normalized return on unseen levels.
arXiv Machine Learning
Sep 11
Measuring the Value of World-Model Updates: A Counterfactual Utility Protocol for Continual Adaptation
arXiv:2609. 10954v1 Announce Type: new Abstract: Continual world models must decide whether new data justify changing the model.
arXiv Machine Learning
Jul 21
When Can Safe Controllers Adapt? Information before Commitment
arXiv:2607. 16895v1 Announce Type: new Abstract: Safe adaptive control is online adaptation under a safety guarantee on the learning trajectory itself.