arXiv Machine Learning
Improving Proactive AI Assistance with Hierarchical Procedural Understanding
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 4
Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance
arXiv:2606. 04970v1 Announce Type: cross Abstract: We envision a proactive multi-modal assistant system which gives users real-time step-by-step guidance on a procedural task, autonomously deciding \textit{when} to interrupt, and \textit{how} to coach.
arXiv Computation and Language
4d ago
NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness
NeoHorse-1 is a family of agent-native models that pursue recursive self‑improvement through agentic post‑training. The system uses a heterogeneous model pool with intelligent routing to record capability demands, service tiers, and interactions, converting these records into training examples that preserve reasoning, tool calls, and harness context. By structuring supervised fine‑tuning into a three‑stage curriculum and employing routing‑guided on‑policy distillation, NeoHorse-1 closes an evaluation‑selection‑update loop, raising macro‑average performance from 58.94 to 64.87 on 4B models and from 65.60 to 69.04 on 9B models across eleven benchmarks, while also producing a prefill‑only variant that outputs structured decisions and probabilities for agent workflows.
Hugging Face Trending Papers
Jun 3
Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance
We envision a proactive multi-modal assistant system which gives users real-time step-by-step guidance on a procedural task, autonomously deciding \textit{when} to interrupt, and \textit{how} to coach. However, progress is limited by the absence of large-scale, cross-domain benchmarks that reflect realistic conditions, particularly the common case in which users deviate from the expected step sequence.
arXiv AI
Jun 2
MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?
arXiv:2606. 01993v1 Announce Type: cross Abstract: Abundant procedural knowledge on the Web holds great potential for helping agents solve long-horizon tasks.
arXiv AI
Jun 16
FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies
arXiv:2605. 27284v2 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models are increasingly expected to not only complete robot tasks, but also follow human instructions about how those tasks should be executed.
arXiv AI
Jun 3
See Less, Specify More: Visual Evidence Budgets for Generalizable VLAs
arXiv:2606. 02735v1 Announce Type: cross Abstract: Generalization remains a central bottleneck for vision-language-action (VLA) models: under distractors, appearance shifts, and semantically similar tasks, the policy must often infer local execution details from coarse instructions while also deciding which parts of the image matter for control.