arXiv Machine Learning By Haoyang Hong, Zichen Wang, Quanquan Gu, Huazheng Wang

Online KL-Regularized Reinforcement Learning with Function Approximation under Misspecification

Read the original on arXiv Machine Learning →

arXiv:2606. 06053v1 Announce Type: new Abstract: We study KL-regularized contextual bandits and episodic reinforcement learning (RL) under general function approximation with model misspecification.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI
5d ago

Annealed Softmax Greedy in Many-Armed Bayesian Bandits

arXiv:2605. 31034v2 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) and group-based policy optimization methods such as GRPO update a stochastic policy by sampling multiple completions per prompt and increasing the policy's probability on those with higher reward, regularized by a KL penalty toward a reference policy.

By William Overman, Mohsen Bayati
arXiv Machine Learning
Jun 5

Exploration via linearly perturbed loss minimisation

arXiv:2311. 07565v3 Announce Type: replace Abstract: We introduce exploration via linear loss perturbations (EVILL), a randomised exploration method for structured stochastic bandit problems that works by solving for the minimiser of a linearly perturbed regularised negative log-likelihood function.

By David Janz, Shuai Liu, Alex Ayoub, Csaba Szepesv\'ari
arXiv Machine Learning
Jul 7

Dynamic Regret for Non-Stationary Linear Bandits via Misspecification Reductions

arXiv:2607. 02891v1 Announce Type: new Abstract: Many online decision-making problems involve both round-specific feasible actions and drifting reward models: eligible ad impressions, feasible prices, and available treatments can change over time, while user preferences, demand curves, and patient responses may evolve.

By Zihao Hu, Yuan Yao, Jiheng Zhang, Zhengyuan Zhou