Reinforcement learning

Policy optimisation, reward modelling and RLHF — how models are trained by feedback rather than by labels.

6,856 stories · RSS feed

arXiv AI
Sep 16

ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents

arXiv:2609.17523v1 Announce Type: new Abstract: We introduce and release ScienceBuddy, an interactive scientific research workspace that brings continually improving scientific agents into researcher...

By Shuhan Xue, Jianyuan Zhong, Ziyuan Nan, Wenbin Li, Zhaochen Yu, Jinchao Ding, Qiang Gao, Pengyu Zhan, Yuntong Zhang, Tian Cheng, Zhenfei Yin, Yingcheng Wu, Ling Yang
arXiv AI
Sep 16

Ave: Guiding Agentic GPU Optimization Using Data-Flow Invariants

arXiv:2604.18616v2 Announce Type: replace-cross Abstract: LLM coding agents can generate correct GPU kernels, but their performance still trails expert libraries. Reaching peak throughput requires co...

By Haohui Mai, Xiaoyan Guo, Xiangyun Ding, Daifeng Li, Qiuchu Yu, Chenzhun Guo, Cong Wang, Jiacheng Zhao, Christos Kozyrakis, Binhang Yuan
arXiv Computation and Language
Sep 16

Rewarding Reasoning, Not Answers: Fixing and Bounding Test-Time Reinforcement Learning on Medical QA

arXiv:2609.16660v1 Announce Type: new Abstract: Test-time reinforcement learning adapts a model on its own unlabeled test set using majority-vote pseudo-labels and has shown strong results in mathema...

By Kailong Fan, Anqi Pu, Yichen Wu, Wanhua Li, Yicong Li, Hanspeter Pfister, Huafeng Liu, Xiang Li, Quanzheng Li, Ning Guo
arXiv Computation and Language
Sep 16

Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization

The paper introduces JudgeBiasBench, a benchmark that systematically quantifies judgment biases in large language model (LLM)-based judges across four dimensions and 12 bias types. It evaluates both generative and discriminative judges, revealing significant bias patterns that undermine reliability. The authors propose bias-aware training—reinforcement learning for generative judges and contrastive learning for discriminative judges—to reduce these biases while maintaining evaluation performance.

By Hongli Zhou, Hui Huang, Rui Zhang, Kehai Chen, Bing Xu, Conghui Zhu, Tiejun Zhao, Muyun Yang
arXiv AI
Sep 15

Windowed A-K-MDP

arXiv:2609.13676v1 Announce Type: new Abstract: Markov decision processes (MDPs) are used to support decision-making in conservation of biodiversity, but policies, even over small state spaces, can b...

By Xiangwen Yang, Frankie Cho, Iadine Chades
arXiv AI
Sep 15

Zonal RL-RRT: Integrated RL-RRT Path Planning with Collision Probability and Zone Connectivity

Zonal RL-RRT is a new path‑planning algorithm that partitions a map into zones using kd‑tree partitioning and employs Value Iteration as a high‑level decision maker. The method achieves a three‑fold improvement in time efficiency over basic sampling methods such as RRT and RRT* in forest‑like maps, and outperforms heuristic‑guided methods like BIT* and Informed RRT* by 1.5× in runtime while maintaining robust success rates across 2D to 6D environments. It also shows on average a 1.5× better performance than learning‑based methods such as NeuralRRT* and MPNetSMP, and has been validated in simulations of a UR10e arm manipulator in MuJoCo.

By Amir Tahmasbi, MohammadSaleh Faghfoorian, Aniket Bera
arXiv AI
Sep 15

CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedback

CHAI for LLMs is a framework that improves large language models’ performance on code‑mixed translation tasks by using LLMs as annotators to create preference data, applying reinforcement learning from AI feedback, incorporating LLM‑generated domain knowledge for iterative refinement, and evaluating on real‑world datasets. The approach yields a 68.45% average win rate over state‑of‑the‑art open‑source models in human‑adjudicated tests. It demonstrates a scalable method to enhance code‑mixed language understanding in open‑source LLMs.

By Wenbo Zhang, Aditya Majumdar, Asif Ekbal, Amulya Yadav