arXiv AI
vla.simd: Efficient CPU Inference for Language-Conditioned Manipulation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Sep 21
vla.simd: Efficient CPU Inference for Language-Conditioned Manipulation
Deploying language-conditioned manipulation without a dedicated GPU requires efficient inference and action chunks that cover the delay between policy queries. We present vla.simd, a CPU inference eng...
arXiv AI
Jul 15
Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference
arXiv:2607. 12659v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have achieved impressive performance on diverse embodied tasks.
arXiv AI
Aug 18
Algorithm-Architecture Co-Design for Efficient VLA Inference via Speculative Inference and Verification
arXiv:2608. 15636v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in the field of embodied AI, but their high computational cost and limited predicted action length hinder real-time deployment.
arXiv AI
Jun 9
vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models
arXiv:2606. 08094v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) policies are typically shipped as Python/PyTorch stacks that assume a workstation-class GPU, a mismatch for the hardware on which robots actually run.
arXiv AI
Sep 17
rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference
The paper introduces rMuscle, a real‑time Vision‑Language‑Action inference framework that mimics human muscle memory to accelerate robotic decision making. By exploiting repeated task similarity, rMuscle uses a dual‑phase cache: a Context Cache reuses visual‑token outputs and an Action Cache reuses neuron activation patterns, reducing computation and weight accesses. Experiments on RTX 4090 and Jetson Thor show 1.29–1.42× speedups on LIBERO, RoboTwin, and physical manipulation tasks while preserving success rates on real robots.
Hugging Face Trending Papers
Sep 16
rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference
Factory work is a promising early scenario for embodied AI: assigning repetitive manual jobs to robots has clear economic payoff, and a structured station keeps the jobs tractable for current policies...