Warp RL: Reshaping Base Policy Distributions for Dynamics Adaptation
arXiv:2606. 31043v1 Announce Type: new Abstract: Residual reinforcement learning adapts a pretrained robot policy by learning an additive correction to its actions.
arXiv:2606. 31043v1 Announce Type: new Abstract: Residual reinforcement learning adapts a pretrained robot policy by learning an additive correction to its actions.
The paper introduces Self‑Adaptive VLA, a post‑training method that lets Vision‑Language‑Action policies self‑adapt to deployment‑time hardware shifts by using rollouts as context. It creates shift‑conditioned expert demonstrations, compresses visual, proprioceptive, and action data into a latent context token, and modulates the policy via adaptive layer normalization. Experiments on four precision‑critical manipulation tasks show the method recovers over 80 % of the base policy’s performance under actuation bias and encoder offsets, and improves robustness on new workstations.
The paper introduces ORPA, a framework that adds a lightweight, feedback-conditioned module to a pretrained robotic manipulation policy, enabling real‑time residual adjustments in joint space without retraining the base policy. ORPA allows immediate correction of execution errors and distribution shifts, improving success rates and recovery on precision‑sensitive tasks compared to baseline policies and rule‑based inverse kinematics. The method is evaluated on the ALOHA platform, showing its effectiveness in real‑time deployment scenarios.
arXiv:2607. 09866v1 Announce Type: cross Abstract: Offline-to-online reinforcement learning is promising for generalizable robotic manipulation, yet its full-stack complexity obscures reproduction and diagnosis.
arXiv:2604. 17787v2 Announce Type: replace-cross Abstract: Precision-critical manipulation requires both global trajectory organization and local execution correction, yet most vision-language-action (VLA) policies generate actions within a single unified space.
arXiv:2603. 13707v3 Announce Type: replace-cross Abstract: Humanoid loco-manipulation requires coordinated task-space motion planning with stable loco-manipulation command tracking under complex robot-environment dynamics and long-horizon tasks.
The paper introduces HiRe-MoMa, a hierarchical residual policy learning framework that fine‑tunes a frozen base policy for mobile manipulation. It uses a policy‑agnostic residual split into mobile‑base and manipulator‑arm heads to reduce gradient interference, and incorporates expert‑guided value alignment to improve sample efficiency with sparse human interventions. Experiments on the TIAGo++ platform show that HiRe‑MoMa boosts task performance after only about 30 minutes of online interaction, regardless of the underlying base policy.
arXiv:2610.16782v1 Announce Type: new Abstract: Industrial manipulation in flexible manufacturing, e.g., high-mix, low-volume (HMLV) electronics assembly, requires robot policies to adapt to changing...
arXiv:2606. 17317v1 Announce Type: cross Abstract: Real-time trajectory generation for on-orbit robotic servicing is challenging due to the nonlinear coupling between spacecraft bus motion, manipulator dynamics, visibility cone, and trajectory-level safety constraints.
arXiv:2606. 06218v1 Announce Type: cross Abstract: A policy tuned for one robot often behaves differently on another, whether due to the sim-to-real gap, unknown payloads, or the differing dynamics of two instances of the same robot.
arXiv:2605. 03065v2 Announce Type: replace Abstract: Generative control policies (GCPs), such as diffusion- and flow-based control policies, have emerged as effective parameterizations for robot learning.
arXiv:2609.38855v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models based on generative frameworks, such as Flow Matching, have recently achieved impressive performance in robotic m...