Aero-VPA: Few-Step Flow-Matching Control over Non-Reconstructive JEPA Latents for Agile Flight on Edge Hardware
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2608. 12308v1 Announce Type: cross Abstract: Aerial vision-language navigation (VLN) requires an embodied agent to integrate visual evidence over time, plan future actions, and determine when it has reached a navigation goal under partial observability.
arXiv:2606. 08094v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) policies are typically shipped as Python/PyTorch stacks that assume a workstation-class GPU, a mismatch for the hardware on which robots actually run.
The paper introduces a compact visual navigation system that decomposes the task into three analytically‑computed geometric interfaces and three small learned modules: an egress predictor, a navigation predictor, and an endpoint‑pinned residual diffusion generator. Only 0.58 M of the 23 M parameters are trained on 44 k frames, achieving competitive success rates and the lowest collision rate among evaluated methods across 6 060 point‑goal episodes in 60 environments. The design allows further parameter reduction by replacing the frozen image encoder with a 0.54 M MobileNetV2, supports zero‑shot deployment on a Jetson Orin Nano UGV, and enables transparent failure analysis under sensor corruption.
X-Fly is a staged training framework designed to improve full‑chunk aerial vision‑language navigation. It uses Recovery DAgger to label learner‑visited states with smooth action chunks and a STOP command, and Flow‑GRPO to jointly refine a chunked flow controller and a Bernoulli STOP policy. The approach achieves 74.18% success rate on test‑seen and 51.73% on test‑unseen, outperforming baseline methods.
The paper introduces a framework for Flow‑Matching Vision‑Language‑Action (VLA) models that allows independent adjustment of backbone depth, action expert depth, and denoising steps. Lightweight Exit Transformers are added at intermediate layers to enable early exits, and a KV Cache synthesis mechanism manages skipped layers so the action expert can exit deeper than the backbone. Experiments on SmolVLA and π0.5 across LIBERO and Meta‑World show that joint tuning of these compute axes reduces latency by 79.2 % and FLOPs by 31.8 %, while improving mean success rate by 5.6 %.
The paper introduces the Just Action Model (JAM), a framework that decouples backbone initialization, future observation objectives, and inference machinery to unify vision-language-action (VLA) and world-action model (WAM) approaches. JAM employs a pretrained visual backbone, an action expert, an action loss, and a foresight loss that predicts future encodings without visual generation, discarding the prediction head after training. Experiments show JAM outperforms FastWAM and ImageWAM on LIBERO, LIBERO-Plus, and RoboTwin, while reducing online training FLOPs by 73%.