arXiv Machine Learning
TEMPO: Learning Temporal Context for Dynamic Robot Manipulation
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Aug 17
Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation
arXiv:2608. 14379v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have recently achieved promising performance in robotic manipulation.
arXiv Computer Vision
Aug 27
StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models
StreamPI introduces a streaming multimodal temporal modeling framework that enhances Vision‑Language‑Action models by adding temporal reasoning without extra parameters. It anchors each visual observation and language instruction pair as a temporal unit, using bidirectional attention for cross‑modal fusion and causal attention for autoregressive streaming inference. The method employs random‑interval streaming training to improve robustness and leverages the LLM backbone’s length extrapolation to inherit pretrained weights, achieving superior performance over pi0.5 on real‑robot and simulation tasks.
Hugging Face Trending Papers
Aug 26
StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models
Vision-Language-Action (VLA) models have demonstrated effectiveness in robot manipulation, yet state-of-the-art models such as pi0.5 operate under a single-frame paradigm, limiting their ability to re...
arXiv AI
Oct 23
PaceVLA: Adaptive Temporal Action Quantization in Vision-Language-Action Models
PaceVLA introduces adaptive temporal action quantization for Vision‑Language‑Action models, enabling faster robot execution by aggregating low‑level actions into coarser steps when appropriate. The framework combines mode‑specific action decoders with a quantizability‑guided mode selection and a context‑conditioned router to decide execution granularity at each inference step. Experiments on simulation benchmarks and real‑world tasks demonstrate that PaceVLA improves execution efficiency while preserving task success rates across diverse embodiments.
arXiv Computer Vision
Oct 2
DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulation
DynamicVLA is a latency‑aware Vision‑Language‑Action model designed for dynamic object manipulation, featuring a compact 0.4B architecture and a convolutional vision encoder for efficient multimodal inference. It employs a continuous inference schedule that overlaps reasoning and execution, and a Latent‑aware Action Streaming mechanism that discards stale action prefixes to maintain action‑time alignment. The authors also introduce the Dynamic Object Manipulation (DOM) benchmark, comprising 200K synthetic episodes and 2K real‑world episodes, and demonstrate that DynamicVLA improves dynamic manipulation success in simulation and on real robots.
Hugging Face Trending Papers
Oct 19
PaceVLA: Adaptive Temporal Action Quantization in Vision-Language-Action Models
Fast and reliable manipulation is crucial for practical robot deployment. Although Vision-Language-Action (VLA) models have recently shown remarkable progress as generalist robot policies, their execu...