Policy optimisation, reward modelling and RLHF — how models are trained by feedback rather than by labels.
arXiv:2609.23589v1 Announce Type: cross Abstract: Large audio-language models (LALMs) are increasingly used for a broader range of audio reasoning tasks. These models typically incorporate audio repr...
arXiv:2609.24660v2 Announce Type: cross Abstract: Human demonstrations offer a scalable way to collect manipulation data, but their contacts may be unstable or infeasible when transferred to a robot...
arXiv:2609.24906v1 Announce Type: cross Abstract: Dormant tree pruning is labor-intensive yet essential for maintaining modern high-productivity fruit orchards. In this work, we focus on pruning of m...
arXiv:2605.01457v4 Announce Type: replace Abstract: How can generative offline multi-agent reinforcement learning achieve both fast joint trajectory generation and effective cooperation? Multi-agent...
arXiv:2603.26687v2 Announce Type: replace-cross Abstract: Hybrid aerial--ground robots can use thrust to cross obstacles that impede wheel-driven motion, but deciding how much thrust to apply during...
arXiv:2609.25701v1 Announce Type: new Abstract: We study distributed Byzantine-resilient actor-critic multi-agent reinforcement learning (AC-MARL), where agents collectively learn policies through lo...
arXiv:2609.26146v1 Announce Type: new Abstract: Risk monitoring in multi-agent systems is commonly built on a per-state primitive that scores each state independently and selects the top K. Under cro...
arXiv:2504.20106v4 Announce Type: replace Abstract: Ensuring that large language models (LLMs) are both helpful and harmless is a critical challenge, as overly strict constraints can lead to excessiv...
arXiv:2608.01069v2 Announce Type: replace Abstract: Bandit algorithms generate data for downstream inference, but adaptive sampling biases post-bandit sample means. We analyze this bias for stable in...
arXiv:2510.17881v4 Announce Type: replace Abstract: Large language models (LLMs) are typically aligned with population-level preferences, despite substantial variation across individual users. We int...
The paper investigates how reinforcement learning can unintentionally obscure the chain‑of‑thought (CoT) reasoning in vision‑language models, making their internal reasoning less traceable. By analyzing activation patterns, the authors show that template‑associated activations become less distinguishable during RL and that targeted interventions can mitigate this effect. They introduce TAME, a method that uses sparse autoencoders to suppress these problematic activations while still encouraging accurate behavior, achieving significant gains in CoT monitorability across multiple datasets and model families.
WeightBridge is a lightweight library that streamlines weight transfer between trainers and rollout generators in reinforcement learning systems, particularly for large language models. It automatically maps trainer and rollout weight layouts, then performs redundancy‑free, load‑balanced transfers while supporting various synchronization modes. Experiments show that WeightBridge can cut GPU stall time by up to 42× compared to leading open‑source RL frameworks, and it was easily integrated into two different frameworks by a coding agent.
KwaiMind is a commercial image editing system that combines general editing capabilities with e-commerce specialization. It uses an agent-based data engine with 1.8 million editing pairs and a multimodal diffusion transformer trained through pre‑training, fine‑tuning, preference optimization, and online reinforcement learning. The system is guided by a vision‑language judge and specialized rewards for click‑through rate, text rendering, and product consistency, and it achieves top scores on ImgEdit, GEdit, REDEdit, and the new Ecom‑Bench, while improving predicted and actual CTR in offline and online experiments.
arXiv:2605.11151v3 Announce Type: replace Abstract: Offline-to-online reinforcement learning (RL) improves sample efficiency by leveraging pre-collected datasets prior to online interaction. A key ch...
Video-HopChain introduces a new dataset of 22,550 multi‑hop video questions over 13,378 videos, each question consisting of three to six yes/no sub‑questions whose integer answers sum to a verifiable reward. Training a Qwen3‑VL‑8B model with GRPO on this dataset improves performance across eight video‑understanding benchmarks from 55.4 to 57.9, and the addition of Confidence‑Gated Exploration (CGE) raises the mean to 59.3. The authors release the dataset, checkpoint, and training code for further research.
arXiv:2609.24526v2 Announce Type: replace Abstract: Physical AI requires models to ground visual and linguistic understanding in real-world environments while accounting for environmental constraints...
Language-model agents increasingly face long-horizon tasks with evolving state, interdependent decisions, and delayed outcomes. Scaling their training requires diverse agentic environments, dependable...
Language-model agents now run the whole of quantitative factor research: they propose investment factors, backtest them, select the survivors and retire them. We ask which of those jobs an agent shoul...
Hindsight relabeling which retroactively replacing a transition's goal with the outcome the agent actually achieved is an effective tool for improving sample-efficiency in Reinforcement Learning (RL)....
Offline reinforcement learning and off-policy evaluation evaluates dynamic treatment rules based on retrospectively collected data prior to deployment. In recent AI applications, state and reward info...