arXiv Machine Learning June 5, 2026 By Kaixuan Liu, Guojun Xiong, Weinan Zhang, Shengpu Tang

Autoregressive Diffusion World Models for Off-Policy Evaluation of LLM Agents

Read the original on arXiv Machine Learning →

arXiv:2606. 05558v1 Announce Type: new Abstract: Evaluating large language model (LLM) agents in multi-turn interactive environments is expensive and risky, as it requires online environment interaction.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jul 21

Masked Diffusion Language Models are Strong and Steerable Text-Based World Models for Agentic RL

arXiv:2607. 16204v1 Announce Type: new Abstract: Recent growth in reinforcement learning (RL) has surfaced a need for diverse, specialized training environments.

By Darshan Deshpande

llms agents diffusion reinforcement-learning fine-tuning efficiency safety

arXiv Machine Learning

Jul 31

TAPO: Transition-Aware Policy Optimization for LLM Agents

arXiv:2607. 27973v1 Announce Type: new Abstract: Recently, Reinforcement Learning (RL) has emerged as a crucial paradigm for the post-training of Large Language Model (LLM) agents.

By Cong Li, Peixi Peng, Yisen Zhao, Xinyu Hu, Shudong Liu, Zhan Su, Zhuojian Li

llms agents reinforcement-learning

arXiv AI

Jun 2

Improving Diffusion Planners by Self-Supervised Action Gating with Energies

arXiv:2603. 02650v2 Announce Type: replace-cross Abstract: Diffusion planners are a strong approach for offline reinforcement learning, but they can fail when value-guided selection favours trajectories that score well yet are locally inconsistent with the environment dynamics, resulting in brittle execution.

By Yuan Lu, Dongqi Han, Yansen Wang, Dongsheng Li

rag diffusion reinforcement-learning robotics benchmarks

arXiv AI

Jun 26

Joint Learning of Experiential Rules and Policies for Large Language Model Agents

arXiv:2606. 27136v1 Announce Type: new Abstract: For LLM agents in multi-step interactive environments, a key challenge is to make effective use of accumulated interaction experience.

By Shicheng Ye, Chao Yu

llms agents

arXiv Machine Learning

Jun 17

EnvRL: Learn from Environment Dynamics in Agentic Reinforcement Learning

arXiv:2606. 17680v1 Announce Type: new Abstract: Reinforcement learning (RL) has emerged as a powerful paradigm for training Large Language Models (LLMs) as agents.

By Zhitong Wang, Songze Li, Hao Peng, Shuzheng Si, Yi Wang, Maosong Sun, Juanzi Li

llms agents reinforcement-learning benchmarks

arXiv AI

Jun 2

COMAP: Co-Evolving World Models and Agent Policies for LLM Agents

arXiv:2606. 02372v1 Announce Type: new Abstract: Equipping language agents with world models enables them to anticipate environment dynamics and evaluate candidate actions before execution.

By Youwei Liu, Jian Wang, Hanlin Wang, Wenjie Li

llms agents robotics efficiency benchmarks

One email a morning, machine-written

Related stories

Masked Diffusion Language Models are Strong and Steerable Text-Based World Models for Agentic RL

TAPO: Transition-Aware Policy Optimization for LLM Agents

Improving Diffusion Planners by Self-Supervised Action Gating with Energies

Joint Learning of Experiential Rules and Policies for Large Language Model Agents

EnvRL: Learn from Environment Dynamics in Agentic Reinforcement Learning

COMAP: Co-Evolving World Models and Agent Policies for LLM Agents