arXiv Machine Learning
SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 16
LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
arXiv:2606. 15768v1 Announce Type: cross Abstract: Vision-Language-Action models (VLAs) leverage large-scale vision-language pretraining for semantic robot control, but often lack explicit foresight into how robot actions change the scene.
arXiv AI
4d ago
LeWAM: A JEPA World Action Model with Diffusion-Steering-Based MPC
LeWAM is a bidirectional transformer that predicts forward, backward, inverse dynamics and policy, trained end‑to‑end on a decoder‑free JEPA latent. It outperforms a forward‑only JEPA world model by better aligning latent representations with robot and object states while ignoring visual distractors. In closed‑loop tests, LeWAM matches a flow‑matching policy of the same size and improves MPC planning by sampling actions in the policy head’s noise space rather than raw actions.
arXiv AI
Aug 5
LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation
arXiv:2608. 03701v1 Announce Type: cross Abstract: World-action modeling has emerged as a promising paradigm for robotic control, as it empowers models to go beyond reacting to observations and anticipate how a scene will evolve.
arXiv Machine Learning
4d ago
WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Models
WAM-Cache is a training‑free framework that reuses layerwise key‑value (KV) representations from a pretrained video Diffusion Transformer (DiT) across control chunks, recomputing only a sparse set of refreshed tokens. By selecting refresh tokens based on the action expert’s cross‑attention, visual latent surprise, and a strict age bound, it reduces DiT prefill FLOPs by 32‑42% on datasets such as RoboTwin 2.0 and LIBERO while maintaining action accuracy within 0.7‑1.8 percentage points of the dense baseline in simulation and 2.5 points on a real robot.
arXiv AI
Sep 30
Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks
arXiv:2609.36471v1 Announce Type: cross Abstract: World-Action Models (WAMs) improve robotic manipulation by conditioning action generation on predicted future observations, but future prediction add...
arXiv Computer Vision
Sep 25
DeltaWAM: Delta World Action Models for Bimanual Manipulation
DeltaWAM introduces a new approach to world-action models (WAMs) for bimanual manipulation by jointly predicting visual deltas and actions instead of dense future frames, thereby reducing redundant modeling of unchanged content and mitigating nuisance appearance variations. The method employs three architectures with varying representation and computation sharing, and incorporates Streaming Delta Memory (SDM) to update cached anchor context using compact observed deltas, which cuts heavy video-expert processing. Experiments on RoboTwin show that DeltaWAM with SDM raises average success rates from 81.3% to 85.4% in clean settings and from 75.8% to 83.9% under visual randomization, while also reducing training FLOPs by up to 23.77% and inference latency by 36.57%. whyItMatters":"DeltaWAM improves both performance and computational efficiency for bimanual manipulation tasks by focusing on visual deltas and efficient memory updates, as demonstrated by higher success rates and lower FLOPs on RoboTwin."