arXiv Machine Learning
Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agents
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Computation and Language
1d ago
Explore Before Committing: Hypothesis-Guided Search for Deep Research Agents
arXiv:2609.01294v1 Announce Type: new Abstract: Deep-research agents answer complex questions by interacting with search and browsing tools, yet they often search along a single evolving trajectory....
arXiv AI
Jul 16
When Agents Disagree With Themselves: Behavioral Consistency as an Uncertainty Signal for LLM Agents
arXiv:2602. 11619v2 Announce Type: replace Abstract: Running the same LLM agent on identical inputs yields 2.
arXiv Machine Learning
Jul 31
Benchmarking the Residual: What Long-Horizon Evaluations Add Beyond Matched Short-Task Performance
arXiv:2607. 27283v1 Announce Type: new Abstract: Long-horizon benchmarks often show that agents fail more as tasks become longer.
arXiv AI
Jul 8
Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade
arXiv:2607. 06503v1 Announce Type: new Abstract: Large language model (LLM) agents solving multi-step tasks frequently commit to trajectories that are doomed to fail, yet continue to consume substantial inference compute before the failure becomes observable.
Hugging Face Trending Papers
Jul 7
Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade
Large language model (LLM) agents solving multi-step tasks frequently commit to trajectories that are doomed to fail, yet continue to consume substantial inference compute before the failure becomes observable. We show that failure is predictable early from the agent's internal representations: lightweight per-round probes on hidden activations anticipate eventual episode failure as early as the first interaction round, where scorers reading only the agent's observable behavior are barely better than chance.
arXiv AI
Jun 2
AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
arXiv:2603. 14465v2 Announce Type: replace Abstract: While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions.