Reinforcement learning

Policy optimisation, reward modelling and RLHF — how models are trained by feedback rather than by labels.

7,110 stories · RSS feed

arXiv Machine Learning

Jul 8

Contextual Procurement Auctions with Bandit Learning

arXiv:2607. 05813v1 Announce Type: cross Abstract: We study repeated contextual procurement auctions in which the platform must learn context-dependent product values from bandit feedback.

By Yiling Chen, Shi Feng, Sadie Zhao

reinforcement-learning

arXiv AI

Jul 8

Beyond Static Evaluation: Building Simulation Environments for Scalable Agentic Reinforcement Learning

arXiv:2607. 05773v1 Announce Type: new Abstract: As Large Language Models (LLMs) evolve into autonomous agents, traditional static evaluation fails to capture multi-step decision-making.

By Akshay Arora, Ishan Nigam, Ashutosh Aggarwal, Shefali Bansal, Krishna Singh, Sweta Kumari, Nikhil Mittal, Shariq Farhan, Siddarth Malreddy

llms agents reinforcement-learning

arXiv Machine Learning

Jul 8

No-Regret Gaussian Process Optimization of Time-Varying Functions

arXiv:2512. 00517v3 Announce Type: replace-cross Abstract: Sequential optimization of black-box functions from noisy evaluations has been widely studied, with Gaussian Process bandit algorithms such as GP-UCB guaranteeing no-regret in stationary settings.

By Eliabelle Mauduit, Elo\"ise Berthier, Andrea Simonetto

reinforcement-learning

arXiv AI

Jul 8

CONFLUX: A Latent Diffusion Model for 3D Chest-CT Synthesis with RL Post-Training

arXiv:2607. 02998v2 Announce Type: replace-cross Abstract: Controllable generative models of 3D medical images can synthesize volumes with specified clinical attributes, but this demands samples that are simultaneously high-fidelity, natively 3D, and faithful to the requested conditioning.

By Max Van Puyvelde, Halil Ibrahim Gulluk, Wim Van Criekinge, Olivier Gevaert

llms diffusion reinforcement-learning

arXiv AI

Jul 8

KAT-Coder-V2.5 Technical Report

arXiv:2607. 05471v1 Announce Type: cross Abstract: We present KAT-Coder-V2.

By Bo Huang, Fengxiang Li, Hao Xu, Haoyang Huang, Hongyi Fu, Jinhua Hao, Kun Yuan, Minglei Zhang, Pengcheng Xu, Shiyang Liu, Wenhao Zhuang, Yuze Shi, Zongxian Feng, Chao Wang, Cheng He, Chongling Rao, Deyu Cao, Fan Yang, Gang Xiong, Haochen Liu, Jiabao Li, Jian Liang, Jinghui Jia, Jingwen Chang, Jun Du, Junyu Shi, Min Li, Mingqi Wu, Qiang Gao, Shangpeng Yan, Shaotong Qi, Shu Xu, Shuo Zhou, Tiankuo Xu, Tong Zheng, Weilun Zhao, Xiancheng Meng, Xianda Sun, Xiaoyu Jiang, Xunhao Jia, Yao Xia, Yimeng Xu, Yinghan Cui, Yingpeng Chen, Yiwen Ning, Yong Wang, Yuxuan Sun, Zhongsheng Liu, Ming Sun, Cheng Luo, Chen Yang, Han Li, Kun Gai

agents reinforcement-learning efficiency benchmarks

arXiv Machine Learning

Jul 8

Streaming Reinforcement Learning under Partial Observability with Real-Time Recurrent Learning

arXiv:2605. 24709v2 Announce Type: replace Abstract: Streaming reinforcement learning has emerged as an online learning paradigm that conforms to the restrictions of natural learning agents that process data incrementally, i.

By Noah Farr, Aryaman Reddi, Carlo D'Eramo, Jan Peters

agents reinforcement-learning

arXiv Machine Learning

Jul 8

Entanglement as a Structural Complexity Axis: A PAC-Bayesian View of Generalization in Quantum Policies and Value Functions

arXiv:2607. 06230v1 Announce Type: cross Abstract: Parameterized quantum circuits (PQCs) are increasingly used as policies and value functions in quantum reinforcement learning, yet it remains unclear when and why quantum policies generalize.

By Jian Xu, Delu Zeng, John Paisley, Qibin Zhao

reinforcement-learning

arXiv AI

Jul 8

From Passive Retrieval to Active Memory Navigation: Learning to Use Memory as a Structured Action Space

arXiv:2607. 05794v1 Announce Type: new Abstract: Long-term user memory is essential for personalized conversational agents, yet many memory systems still expose memory through passive retrieval interfaces, making the model a consumer of pre-selected evidence.

By Yue Xu, Yutao Sun, Yihao Liu, Mengyu Zhou, Jiayi Qiao, Lu Ma, Kai Tang, Wenjie Wang, Xiaoxi Jiang, Guanjun Jiang

agents reinforcement-learning

arXiv Machine Learning

Jul 8

Strategic Bargaining in Multi-Buyer Markets: Reinforcement Learning from Verifiable Rewards for LLM Negotiations

arXiv:2607. 05863v1 Announce Type: new Abstract: Negotiation is a fundamental strategic interaction in management science, characterized by agents attempting to reach agreements while protecting private information, such as reservation costs and hidden valuations.

By Shuze Daniel Liu, Claire Chen, Jiabao Sean Xiao, Xin Chen, David Simchi-Levi

llms agents reinforcement-learning

arXiv AI

Jul 8

Multi-Agent Deep Reinforcement Learning for Multi Objective Battery Management in Dairy Farms

arXiv:2607. 06489v1 Announce Type: new Abstract: The dairy industry in Ireland has a large potential for the integration of renewable energy and the reduction of carbon emissions.

By Marcos Eduardo Cruz Victorio, Karl Mason

agents reinforcement-learning

arXiv Machine Learning

Jul 8

GraphAllocBench: A Flexible Benchmark for Preference-Conditioned Multi-Objective Policy Learning

arXiv:2601. 20753v4 Announce Type: replace Abstract: Preference-Conditioned Policy Learning (PCPL) in Multi-Objective Reinforcement Learning (MORL) approximates diverse Pareto-optimal solutions by conditioning a single policy on user-specified preferences, enabling run-time adaptation to arbitrary trade-offs without retraining.

By Zhiheng Jiang, Yunzhe Wang, Ryan Marr, Ellen Novoseller, Benjamin T. Files, Volkan Ustun

reinforcement-learning benchmarks

arXiv Machine Learning

Jul 8

Learning to Throw Objects Safely in Multi-Obstacle Environments

arXiv:2607. 06388v1 Announce Type: cross Abstract: Robotic throwing enables fast and efficient object placement beyond the robot's immediate workspace, but reliable throwing in cluttered environments remains underexplored.

By Mohammadreza Kasaei, Klemen Voncina, Hamidreza Kasaei

reinforcement-learning robotics benchmarks

arXiv AI

Jul 8

FootsiesGym: A Fighting Game Benchmark for Two-Player Zero-Sum Imperfect-Information Games

arXiv:2607. 06514v1 Announce Type: new Abstract: We present FootsiesGym, an open-source environment for learning in a non-trivial two-player, zero-sum, imperfect-information game.

By Chase McDonald, Nathan Tsang, Wesley N. Kerr

reinforcement-learning efficiency benchmarks

arXiv AI

Jul 8

From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulation

arXiv:2603. 15600v2 Announce Type: replace-cross Abstract: Accurate process supervision remains a critical challenge for long-horizon robotic manipulation.

By Yibin Liu, Yaxing Lyu, Daqi Gao, Zhixuan Liang, Weiliang Tang, Shilong Mu, Xiaokang Yang, Yao Mu

reinforcement-learning robotics fine-tuning benchmarks

arXiv Machine Learning

Jul 8

HERB: Human-augmented Efficient Reinforcement learning for Bin-packing

arXiv:2504. 16595v2 Announce Type: replace-cross Abstract: Packing objects efficiently is a fundamental problem in logistics, warehouse automation, and robotics.

By Gojko Perovic, Nuno Ferreira Duarte, Atabak Dehban, Gon\c{c}alo Teixeira, Egidio Falotico, Jos\'e Santos-Victor

reinforcement-learning robotics

arXiv AI

Jul 8

CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration

arXiv:2607. 05465v1 Announce Type: cross Abstract: Complex image creation and editing often require more than a single generation or editing model.

By Hairui Zhu, Yiying Yang, Tengjin Weng, Ziyu Lu, Xiao Yao, Xiaoyang Ye, Lin Ma, Wenhao Jiang

agents reinforcement-learning robotics fine-tuning multimodal

arXiv AI

Jul 8

PCBWorld: A Benchmark Environment for Engine-Grounded PCB Design Automation

arXiv:2607. 05915v1 Announce Type: new Abstract: PCB routing is the task of connecting the nets of a board with copper traces under strict design rules, yet learning-based methods still lag behind rule-based routers.

By Hyungseok Song, Junseok Park, Won-Seok Choi, Seohui Bae, Han-Seul Jeong, Youngjoon Park, Soonyoung Lee

llms agents reinforcement-learning benchmarks

arXiv Machine Learning

Jul 8

Deep Reinforcement Learning for Dynamic Battery Management of Autonomous Order Pickers

arXiv:2607. 05683v1 Announce Type: new Abstract: Battery charging of Autonomous Mobile Robots (AMRs) in warehouses is a critical operational challenge that heavily impacts both order processing times and throughput.

By Taniya Shaji, Abhay Sobhanan, Christof Defryn

agents reinforcement-learning robotics efficiency benchmarks

arXiv Machine Learning

Jul 8

Mitigating Factual Hallucination in Large Reasoning Models via Mixed-Mode Advantage Regularization

arXiv:2607. 05861v1 Announce Type: cross Abstract: Large reasoning models (LRMs) improve language model capabilities by generating explicit thinking traces before final answers.

By Kaishen Wang, Tong Zheng, Xuehao Cui, Ruibo Chen, Tianyi Xiong, Heng Huang

llms nlp reinforcement-learning benchmarks safety

arXiv AI

Jul 8

To Retain or to Adapt? Generalizing Continual Learning

arXiv:2607. 05609v1 Announce Type: cross Abstract: The Continual Learning (CL) literature has long been driven by the goal of mitigating catastrophic forgetting.

By Giulia Lanzillotta, Mandana Samiei, Doina Precup, Razvan Pascanu, Claire Vernade

computer-vision reinforcement-learning benchmarks safety

Get the daily briefing