arXiv AI
Aug 3
SERUM: State Extraction and Refinement for User Modeling
arXiv:2607. 29181v1 Announce Type: cross Abstract: Agentic assistants capable of proactive, personalized interactions require structured models of user intent and workflow.
See Better, Foresee Better, Act Wiser: Physically Grounded Proactive Modeling and Decision Making
Related stories
arXiv AI
Jun 17
ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model
arXiv:2603. 22281v2 Announce Type: replace-cross Abstract: Recent progress in latent world models (e.
arXiv AI
Aug 18
Intent-Driven Situation Tracking for User-Centric Multi-Turn Agents
arXiv:2608. 15755v1 Announce Type: new Abstract: User-centric multi-turn agents must act on an evolving task situation shaped by changing user intents, accumulated tool-grounded facts, missing information, and execution constraints.
arXiv AI
Jul 14
Vinci2: Providing Proactive Assistance in Continuous Egocentric Videos
arXiv:2607. 11523v1 Announce Type: cross Abstract: When should an intelligent assistant speak up without being asked?
Hugging Face Trending Papers
Aug 26
Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization
Zero-shot cross-task generalization, where a policy must execute manipulation tasks never seen during training, remains a central challenge in robot learning. In large language models, a novel task ca...
arXiv Machine Learning
Jun 16
How Should World Models Be Evaluated? A Decision-Making-Centric Position
arXiv:2606. 15032v1 Announce Type: new Abstract: World models have rapidly become one of the central abstractions in modern AI.
arXiv Computer Vision
Aug 27
Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization
Zero-WAM introduces a causal video-action model that enables robots to perform unseen manipulation tasks by following in-context human video guidance. The authors create HumanGen, a dataset of 74.2K human-robot ICL pairs across 8.6K tasks, and propose an in-context future chunk prediction objective to prevent shortcut learning. In simulation, Zero-WAM attains a 47.0% success rate on seven unseen tasks, outperforming the best video-action baseline by 29.5 percentage points, and demonstrates real‑world generalization to complex, long‑horizon, and fine‑grained tasks.
arXiv AI
Aug 13
Foresight Without Seeing: Latent Futures for World Action Models
arXiv:2608. 11605v1 Announce Type: new Abstract: World Action Models (WAMs) couple future visual prediction with robot action generation, enabling policies to model how the physical world evolves during interaction.
Hugging Face Trending Papers
Jun 1
WALL-WM: Carving World Action Modeling at the Event Joints
WALL-WM is a World Action Model that shifts video-action learning from chunk-centric optimization to event-grounded Vision-Language-Action pretraining, using semantically coherent action events as the atomic unit of learning. Existing WAMs commonly initialize from multimodal or video foundation models and then optimize fixed-length action chunks conditioned directly on the current observation and instruction.
arXiv AI
Sep 10
Learning Counterfactual World Models for Embodied Reasoning under Partial Observability
arXiv:2609.05834v1 Announce Type: new Abstract: World models promise a general route to embodied intelligence: learn predictive dynamics once, then reason, plan, and act with them. Increasingly, the...
arXiv AI
Jun 2
Pause and Think: A Dataset and Benchmark for Video-Grounded Assistive Action Suggestion
arXiv:2606. 00616v1 Announce Type: cross Abstract: Recent Vision-Language Models (VLMs) struggle with grounded reasoning, temporal consistency, and context aware planning in videos.
arXiv AI
Jul 9
Large Behavior Model: A Promptable Digital Twin of the Retail Customer
arXiv:2607. 06993v1 Announce Type: new Abstract: Customer behavior modeling underpins recommendation, marketing, and decision support, yet existing approaches either optimize predictive accuracy without explaining decisions or simulate users without grounding them in real behavioral data.