OdysseyArena: Benchmarking Large Language Models For Long-Horizon, Active and Inductive Interactions
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
arXiv:2607. 05174v1 Announce Type: new Abstract: Language agents, i.
arXiv:2601. 21754v3 Announce Type: replace Abstract: While Large Language Models (LLMs) excel in language-based agentic tasks, their applicability to unseen, nonlinguistic environments (e.
arXiv:2510. 19771v4 Announce Type: replace Abstract: LLM-based agents are increasingly moving towards proactivity: rather than awaiting instruction, they exercise agency to anticipate user needs and solve them autonomously.
GRASP is a multi-stage planning framework that improves the reliability of large language models on complex tasks. It separates planning into three specialized modules—GenPlan for global macro-guidelines, RevPlan for exploring localized strategies, and VerPlan for multi-criteria evaluation—allowing context isolation and strict macro-regularization. Experiments show GRASP outperforms direct LLM planners by significant margins on datasets such as Natural Plan Calendar Scheduling, ZebraLogic, and SciBench Math, and it mitigates performance collapse in multi-task and dual-task settings.
PIVOT (Plan-Inspect-eVOlve Trajectories) is a self‑supervised framework that refines large‑language‑model agent plans by treating trajectories as optimizable objects. It operates in four stages—PLAN, INSPECT, EVOLVE, and VERIFY—using structured losses and textual gradients to iteratively improve trajectories and ensure compliance with task constraints. Experiments on DeepPlanning and GAIA show that PIVOT achieves up to 94% relative improvement in constraint satisfaction with human‑in‑the‑loop feedback and still delivers significant gains autonomously, while using 3x to 5x fewer tokens than competing methods.
arXiv:2606. 05080v1 Announce Type: new Abstract: Scientific and engineering progress is fundamentally a long-horizon iterative process: proposing changes, running experiments, measuring outcomes, and continuously refining artifacts.