arXiv AI By Yang Zhang, Jiangyuan Zhao, Chenyou Fan, Jiayu Hu, Xiu Yuan, Chenjia Bai, Xiu Li

V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Computer Vision
Sep 21

MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generation

MT‑WAM enhances the Fast‑WAM framework by adding complementary supervision for future 2‑D point trajectories and visual features while keeping the original training objectives. A lightweight dual‑stream branch and structured attention mask isolate motion‑specific processing, and motion‑stream tokens provide additional dynamics cues to the action expert. During inference, MT‑WAM skips future‑video prediction, using cached video and motion information to achieve higher success rates on LIBERO, LIBERO‑Plus, RoboTwin 2.0 Clean2Rand, and several real‑world tasks.

By Yiguang Yang, Jiankun Peng, Xiaoming Wang, Yiran Zhang, Zhibo Fang
arXiv AI
Oct 31

SaiVLA-JEPA: Evaluating Future Latent Prediction in JEPA-Conditioned VLA Control

SaiVLA-JEPA is a family of vision‑language‑action policies that condition on frozen V‑JEPA features and use lightweight auxiliary heads to predict future latent representations during training. Experiments on 10,030 LIBERO‑Plus episodes show that JEPA conditioning improves success rates to about 82.5% versus 71.6% without JEPA, but adding future supervision does not yield a detectable aggregate gain. Variants that adapt latent context or selected parameters provide mixed results, suggesting that latent‑prediction objectives should be evaluated via closed‑loop rollouts rather than latent loss alone.

By Rufeng Xiao (VLA Research Team, Synthoid.ai), Ruihao Xiao (VLA Research Team, Synthoid.ai), Wei Chen (VLA Research Team, Synthoid.ai), Xinhai Sun (VLA Research Team, Synthoid.ai)