arXiv Computation and Language
Co-Evolving Actor-Conditioned Critics for Non-Verifiable Generation
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv AI
Oct 7
EnGRICH: Enhancing Generative Reward Modeling with Critiques from Humans
arXiv:2610.05370v2 Announce Type: replace Abstract: Generative reward models (GRMs) are important for LLM optimization. Unlike scalar reward models, GRMs generate natural-language critiques alongside...
arXiv AI
Sep 10
CriticGen: Generation-Aware Evaluation as Actionable Feedback
CriticGen introduces a generation‑aware evaluation framework that generates sample‑specific evaluation dimensions and scoring criteria across categories such as subjective, objective, and self‑derived constraints. These dynamic rubrics produce a score, reason, executable refinement suggestion, and a refined answer, enabling models to diagnose and target flaws in their responses. Experiments show significant gains in rubric quality, score correlation, and actionable feedback, with 73.17% of answers improved and a 93.28% non‑degradation rate.
arXiv AI
Jun 2
Weak Critics Make Strong Learners: On-Policy Critique Distillation for Scalable Oversight
arXiv:2606. 00424v1 Announce Type: new Abstract: As large language models become stronger, weak supervisors may fail to provide reliable labels, preferences, or final judgments for complex outputs, limiting both weak-to-strong generalization and scalable oversight.
arXiv Computation and Language
Sep 1
CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents
CAST is a critique‑aware training framework that transforms sparse task outcomes into action‑level supervision for both critique learning and policy optimization. By analyzing agent trajectories, CAST synthesizes structured rationales that explain action validity under partial observability, enabling the creation of richer training data. Fine‑tuned Qwen3‑family models trained with CAST show significant reliability gains, outperforming GPT‑OSS‑120B by over 10% on Retail tasks and improving Telehealth performance by 9% in an out‑of‑domain setting.
arXiv Computation and Language
Oct 15
Beyond Corrected Actions: Training LLM Agents on Textual Critiques
arXiv:2610.19367v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for multi-turn agentic tasks that require interactions with users and environments over extended seq...
arXiv AI
Oct 7
Selective Critique for Cost-Aware LLM Agents in Long-Horizon Decision Making
arXiv:2610.07335v1 Announce Type: cross Abstract: Improving the reliability of large language model (LLM) agents in long-horizon decision-making remains a key challenge. When deployed as autonomous a...