arXiv AI
Jul 13
Prompt-Driven Exploration
arXiv:2607. 08837v1 Announce Type: cross Abstract: Exploration is essential to RL since a policy cannot improve by repeatedly sampling the behaviors it already prefers.
Corrigibility Transformation: Constructing Goals That Accept Updates
arXiv:2510. 15395v2 Announce Type: replace Abstract: An AI agent will learn a desired goal more effectively if it does not resist the training process, but many partially learned goals incentivize an AI to avoid further goal updates.
Related stories
arXiv AI
Jun 16
Reward Hacking in Language Model Agents: Revisiting AI Safety Gridworlds
arXiv:2606. 15385v1 Announce Type: new Abstract: Reward hacking, where AI systems exploit misspecified objectives to achieve high reward without satisfying intended goals, remains a central challenge in AI safety.
arXiv AI
Jul 17
Reward-Free Evolving Agents via Pairwise Validator
arXiv:2607. 14408v1 Announce Type: new Abstract: A self-evolving agentic loop repeatedly proposes a tweaked version of an agent (its prompt template or program) and accepts or rejects the change based on a per-iteration quality signal.
arXiv AI
Jun 15
Unsupervised Learning of Efficient Exploration: Pre-training Adaptive Policies via Self-Imposed Goals
arXiv:2601. 19810v2 Announce Type: replace-cross Abstract: Unsupervised pre-training can equip reinforcement learning agents with prior knowledge and accelerate learning in downstream tasks.
arXiv AI
Jun 2
COMAP: Co-Evolving World Models and Agent Policies for LLM Agents
arXiv:2606. 02372v1 Announce Type: new Abstract: Equipping language agents with world models enables them to anticipate environment dynamics and evaluate candidate actions before execution.
arXiv AI
Jun 26
The Verification Horizon: No Silver Bullet for Coding Agent Rewards
arXiv:2606. 26300v1 Announce Type: new Abstract: A classical intuition holds that verifying a solution is easier than producing one.
arXiv AI
Jun 6
From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents
arXiv:2606. 05805v1 Announce Type: new Abstract: LLM-based guardrails typically safeguard agents by evaluating proposed actions or inputs before execution, producing safety signals such as binary allow/deny decisions, risk categories, and/or explanatory rationales about potential policy violations.
arXiv AI
Jul 16
Self-Improvements in Modern Agentic Systems: A Survey
arXiv:2607. 13104v1 Announce Type: new Abstract: Self-improving autonomous agents are moving from research prototypes to deployed systems.
arXiv Machine Learning
Jun 11
Anatomy of Post-Training: Using Interpretability to Characterize Data and Shape the Learning Signal
arXiv:2606. 12360v1 Announce Type: new Abstract: Language-model post-training is the main stage at which model behavior is shaped, yet it still largely involves optimization of scalar rewards that summarize diverse desiderata.
arXiv AI
Jun 30
Pushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic Optimization
arXiv:2602. 11351v2 Announce Type: replace Abstract: Proactive large language model (LLM) agents aim to actively plan, query, and interact over multiple turns, enabling efficient task completion beyond passive instruction following and making them essential for real-world, user-centric applications.
arXiv AI
Aug 10
The Optimizer Is the Agent: Reasoning-Driven Search across Prompts, Programs, and ML Workflows
arXiv:2608. 06714v1 Announce Type: new Abstract: Recent systems for optimizing prompts, programs, and ML workflows typically rely on explicit outer-loop controllers such as evolutionary search, bandits, or textual-gradient methods.
Hugging Face Trending Papers
Jun 19
Training the Orchestrator: A Supervised Approach to End-to-End PDDL Planning with LLM Agents
Translating natural-language planning intent into verified plans is a longstanding challenge: people communicate goals in language, while classical planners require formal PDDL specifications. Recent agentic frameworks bridge this gap by orchestrating a pool of specialized repair agents inside a verifier-checked refinement loop, but the orchestrator at the centre is itself a prompted frontier LLM, paying a frontier-LLM API call at every refinement step.