arXiv:2610.03792v2 Announce Type: replace Abstract: Reinforcement learning from verifiable rewards (RLVR) has produced large reasoning gains in language models, and verifiable video benchmarks make i...
arXiv:2512. 05277v4 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as the perception and reasoning backbone of autonomous agents acting in the wild, with autonomous driving (AD) being one of the most safety-critical instances.
arXiv:2512. 05277v3 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as the perception and reasoning backbone of autonomous agents acting in the wild, with autonomous driving (AD) being one of the most safety-critical instances.
arXiv:2609.09985v1 Announce Type: new Abstract: Real-world video understanding requires integrating visual, audio, textual, and temporal evidence distributed across a video. Yet many pipelines use a...
VAMR is a video agent that handles multiple questions about a single long‑form video using a single shared tool‑use trajectory, rather than treating each question separately. It employs question‑conditioned visual perception, layered multi‑question memory, and a question‑horizon policy optimization to jointly acquire evidence and progressively build a shared understanding. In benchmark tests (LVBench, Video‑Holmes, LongVideoBench), VAMR outperforms prior methods, achieving higher accuracy and fewer reasoning rounds and processed frames.
The paper introduces Behavior Pack Optimization (BPO), a post‑training method for video multimodal large language models that replaces single‑response rewards with a set of outputs across counterfactual views. BPO enforces stability when interventions are irrelevant, sensitivity when key evidence is removed, and abstention when no evidence remains, using an anchor‑relative advantage to keep the objective stable with small pack sizes. Experiments on datasets such as TempCompass, MVBench, and NExT‑QA show that BPO improves macro accuracy and abstention metrics for models like Qwen2.5‑VL‑7B‑Instruct, with gains that transfer to other benchmarks and models.
arXiv:2607. 15621v1 Announce Type: cross Abstract: Large language models bring instruction following and scene reasoning to end-to-end driving, but their inference latency collides with the control rate a vehicle requires.
arXiv:2610.17540v1 Announce Type: new Abstract: Textual reasoning before acting has improved vision-language-action (VLA) models, but at the cost of latency: every action conditioned on the reasoning...
The paper introduces ACT3D, a vision‑language model that learns to think and explore in 3D environments using only single‑image inputs and action‑based interactions. By fine‑tuning with trajectory supervision and then applying reinforcement learning driven by final‑answer correctness, ACT3D develops an exploration policy that adapts to the question and improves accuracy across six benchmarks, outperforming both proprietary and open‑source baselines while using fewer input frames. The study shows that outcome‑based RL can teach VLMs to decide when and how to acquire visual evidence, leading to better reasoning and spatial understanding.
arXiv:2609.28049v1 Announce Type: cross Abstract: Video understanding is usually benchmarked on curated, single-actor, or professionally filmed clips, and a strong score there is routinely read as ev...
arXiv:2608.28675v1 Announce Type: cross Abstract: Video reasoning tasks such as grounded video question answering and temporal grounding require selecting temporal evidence that supports the query. I...
The paper proposes a method to distill world‑model representations into compact Vision‑Language‑Action (VLA) policies. By adding a single feature‑alignment term during VLA training, a frozen world model’s internal features are cached and the student policy learns to match them, eliminating the need for a generative future‑rolling component. The resulting lightweight policy runs in 32 ms on an RTX 5090, achieving high performance on LIBERO and RoboCasa‑GR1, and transfers effectively to real robotic hardware.