arXiv AI
Same Signal, Opposite Meaning: Direction-Informed Adaptive Learning for LLM Agents
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 3
PAIR: Prefix-Aware Internal Reward Model for Multi-Turn Agent Optimization
arXiv:2605. 17877v2 Announce Type: replace Abstract: A significant hurdle for current LLMs is the execution of complex, multi-stage tasks.
arXiv Machine Learning
Jun 9
Reformulate LLM Reinforcement Learning for Efficient Training under Black-box Discrepancy
arXiv:2606. 08779v1 Announce Type: new Abstract: Reinforcement Learning (RL) has emerged as a pivotal post-training paradigm, yet it frequently suffers from unpredictable sub-optimum performance or even training collapses.
arXiv Machine Learning
5d ago
Steering Vectors as a Training Signal in LLM Post-Training
Steering vectors (SVs) are residual-stream directions that can shift LLM behavior when added to hidden states during inference. This study investigates whether the same SVs can guide parameter updates during post‑training, exploring supervised learning (SFT and distillation) and reinforcement learning with verifiable rewards (RLVR). The authors find that SV injection improves performance over plain SFT and distillation, achieving up to a 12% gain in certain distillation settings, and that applying a correctness‑contrast direction as advantage repair in RL recovers learning signals for held‑out math benchmarks. They also identify failure boundaries related to code generation, cross‑family layer transfer, and inference‑time application on SV‑trained checkpoints.
arXiv AI
Jul 7
LLM-as-a-Tutor: Policy-Aware Prompt Adaptation for Non-Verifiable RL
arXiv:2607. 04412v1 Announce Type: new Abstract: Reinforcement learning (RL) for non-verifiable instruction following increasingly relies on LLM judges with prompt-specific rubrics as reward signals.
arXiv Machine Learning
Jun 25
FBOS-RL: Feedback-Driven Bi-Objective Synergistic Reinforcement Learning
arXiv:2605. 20256v2 Announce Type: replace Abstract: Reinforcement learning has become a cornerstone for aligning and unlocking the reasoning capabilities of large-scale models.
arXiv AI
Jul 17
Reward-Free Evolving Agents via Pairwise Validator
arXiv:2607. 14408v1 Announce Type: new Abstract: A self-evolving agentic loop repeatedly proposes a tweaked version of an agent (its prompt template or program) and accepts or rejects the change based on a per-iteration quality signal.