arXiv Computation and Language September 1, 2026 By Amir Saeidi, Zehua Zhang, Rishitosh Singh, Naman Ahuja, Vivek Gupta, Ali Payani, Gaowen Liu, Jayanth Srinivasa, Chitta Baral

CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents

Read the original on arXiv Computation and Language →

CAST is a critique‑aware training framework that transforms sparse task outcomes into action‑level supervision for both critique learning and policy optimization. By analyzing agent trajectories, CAST synthesizes structured rationales that explain action validity under partial observability, enabling the creation of richer training data. Fine‑tuned Qwen3‑family models trained with CAST show significant reliability gains, outperforming GPT‑OSS‑120B by over 10% on Retail tasks and improving Telehealth performance by 9% in an out‑of‑domain setting.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI

Jun 30

SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Models

arXiv:2601. 03555v3 Announce Type: replace Abstract: Training reliable tool-augmented agents remains a significant challenge, largely due to the difficulty of credit assignment in multi-step reasoning.

By Yuxuan Jiang, Francis Ferraro

llms agents reinforcement-learning benchmarks

arXiv AI

Jun 2

AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents

arXiv:2603. 14465v2 Announce Type: replace Abstract: While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions.

By Shengda Fan, Xuyan Ye, Yupeng Huo, Zhi-Yuan Chen, Yiju Guo, Shenzhi Yang, Wenkai Yang, Shuqi Ye, Jingwen Chen, Haotian Chen, Xin Cong, Yankai Lin

llms agents benchmarks

arXiv AI

Sep 2

Steer, Don't Solve: Training Small Critic Models for Large Code Agents

arXiv:2606.21811v2 Announce Type: replace-cross Abstract: Coding tasks are typically complicated and require multiple capabilities, ranging from high-level planning to low-level implementation. While...

By Shubham Gandhi, Yiqing Xie, Atharva Naik, Ruichen Zhu, Carolyn Rose

llms agents reinforcement-learning fine-tuning

arXiv AI

Jul 8

Learning to Control LLM Agent Harnesses with Offline Reinforcement Learning

arXiv:2607. 05458v1 Announce Type: cross Abstract: Large language model (LLM) agents are usually improved by changing prompts, models, or hand-written workflows, while the execution harness around the model is treated as fixed infrastructure.

By Haiwen Yi, Xinyuan Song

llms agents reinforcement-learning benchmarks

arXiv AI

Jun 6

From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents

arXiv:2606. 05805v1 Announce Type: new Abstract: LLM-based guardrails typically safeguard agents by evaluating proposed actions or inputs before execution, producing safety signals such as binary allow/deny decisions, risk categories, and/or explanatory rationales about potential policy violations.

By Yuhao Sun, Jiacheng Zhang, Shaanan Cohney, Zhexin Zhang, Feng Liu, Xingliang Yuan

llms agents safety

arXiv AI

Jul 7

LLM-as-a-Tutor: Policy-Aware Prompt Adaptation for Non-Verifiable RL

arXiv:2607. 04412v1 Announce Type: new Abstract: Reinforcement learning (RL) for non-verifiable instruction following increasingly relies on LLM judges with prompt-specific rubrics as reward signals.

By Yujin Kim, Namgyu Ho, Sangmin Hwang, Joonkee Kim, Yongjin Yang, Sangmin Bae, Seungone Kim, Jaehun Jung, Se-Young Yun, Hwanjun Song

llms reinforcement-learning benchmarks

One email a morning, machine-written

Related stories

SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Models

AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents

Steer, Don't Solve: Training Small Critic Models for Large Code Agents

Learning to Control LLM Agent Harnesses with Offline Reinforcement Learning

From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents

LLM-as-a-Tutor: Policy-Aware Prompt Adaptation for Non-Verifiable RL