Warp: Structured Output-Space Adaptation for Frozen Robot Policies
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2606. 31043v1 Announce Type: new Abstract: Residual reinforcement learning adapts a pretrained robot policy by learning an additive correction to its actions.
The paper introduces Self‑Adaptive VLA, a post‑training method that lets Vision‑Language‑Action policies self‑adapt to deployment‑time hardware shifts by using rollouts as context. It creates shift‑conditioned expert demonstrations, compresses visual, proprioceptive, and action data into a latent context token, and modulates the policy via adaptive layer normalization. Experiments on four precision‑critical manipulation tasks show the method recovers over 80 % of the base policy’s performance under actuation bias and encoder offsets, and improves robustness on new workstations.
The paper introduces ORPA, a framework that adds a lightweight, feedback-conditioned module to a pretrained robotic manipulation policy, enabling real‑time residual adjustments in joint space without retraining the base policy. ORPA allows immediate correction of execution errors and distribution shifts, improving success rates and recovery on precision‑sensitive tasks compared to baseline policies and rule‑based inverse kinematics. The method is evaluated on the ALOHA platform, showing its effectiveness in real‑time deployment scenarios.
arXiv:2607. 09866v1 Announce Type: cross Abstract: Offline-to-online reinforcement learning is promising for generalizable robotic manipulation, yet its full-stack complexity obscures reproduction and diagnosis.
arXiv:2604. 17787v2 Announce Type: replace-cross Abstract: Precision-critical manipulation requires both global trajectory organization and local execution correction, yet most vision-language-action (VLA) policies generate actions within a single unified space.
arXiv:2603. 13707v3 Announce Type: replace-cross Abstract: Humanoid loco-manipulation requires coordinated task-space motion planning with stable loco-manipulation command tracking under complex robot-environment dynamics and long-horizon tasks.