Hugging Face Trending Papers

JitterVLA: A Replay Benchmark for Motion Quality in VLA-Driven Human-Robot Manipulation

Read the original on Hugging Face Trending Papers →

JitterVLA is a replay benchmark designed to evaluate motion quality in vision‑language‑action (VLA) driven human‑robot manipulation. It replays identical command sequences and arrival traces through different controllers to isolate controller effects, testing on synthetic reaches, hand trajectories from 20 people, three open VLA pipelines (838 episodes), and a physical UR3 robot. The benchmark shows that interpolation reduces modeled p99 jerk by 83% for human motion with a 200 ms delay, and that jerk‑limited generation further lowers jerk at a higher cost, while entropy‑based methods yield mixed results across pipelines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Machine Learning
Oct 12

JitterVLA: A Replay Benchmark for Motion Quality in VLA-Driven Human-Robot Manipulation

JitterVLA is a replay benchmark designed to evaluate motion quality in vision‑language‑action (VLA) driven human‑robot manipulation. It replays identical command and arrival traces through different controllers to isolate controller effects, and is applied to synthetic reaches, hand trajectories from 20 people, three open VLA pipelines (838 episodes), and a physical UR3 robot. The benchmark demonstrates that interpolation reduces modeled p99 jerk by 83% for human motion with a 200 ms delay, while jerk‑limited generation further lowers jerk at a higher cost, and shows varying effects of entropy‑based techniques across pipelines.

By Faith Ogunwoye, Didar Seyidov, Konstantin Gubernatorov, Dzmitry Tsetserukou
arXiv AI
Aug 24

ForeTime-VLA: Causal Future-Token Distillation from a World Action Model for Conveyor-Belt Manipulation

ForeTime‑VLA is a causal vision‑language‑action policy that distills future‑aware representations from a frozen Fast‑WAM teacher, enabling it to anticipate contact events during conveyor‑belt manipulation. The method compresses current and future video latents into a 64‑dimensional target, uses an eight‑frame history encoder to predict this target along with manipulation phase and time‑to‑transition, and conditions a VLM prefix on future tokens and phase. On a deduplicated conveyor‑belt dataset, ForeTime‑VLA reduces test MAE by 2.63% and L2 by 3.02%, while real‑robot experiments show significantly higher grasp success rates compared to the next‑best reference. whyItMatters":"The approach demonstrates that distilling future‑token knowledge from a world‑action model can improve dynamic manipulation performance without the computational cost of running the teacher at inference time."

By Siyuan Ma, Yutian Zhang, Boshi Zhang, Qinglian Wu, Jiaqi Zhai, Dong Wei, Xiaojin Huang
arXiv Computer Vision
Sep 25

DeltaWAM: Delta World Action Models for Bimanual Manipulation

DeltaWAM introduces a new approach to world-action models (WAMs) for bimanual manipulation by jointly predicting visual deltas and actions instead of dense future frames, thereby reducing redundant modeling of unchanged content and mitigating nuisance appearance variations. The method employs three architectures with varying representation and computation sharing, and incorporates Streaming Delta Memory (SDM) to update cached anchor context using compact observed deltas, which cuts heavy video-expert processing. Experiments on RoboTwin show that DeltaWAM with SDM raises average success rates from 81.3% to 85.4% in clean settings and from 75.8% to 83.9% under visual randomization, while also reducing training FLOPs by up to 23.77% and inference latency by 36.57%. whyItMatters":"DeltaWAM improves both performance and computational efficiency for bimanual manipulation tasks by focusing on visual deltas and efficient memory updates, as demonstrated by higher success rates and lower FLOPs on RoboTwin."

By Han Yan, Zishang Xiang, Haokai Jiang, Zeyu Zhang, Qilin Wang, Weiyu Guo, Yandong Guo, Boxin Shi, Hao Tang