arXiv Machine Learning
What Does It Take For A Generalist Robot Policy To Adapt Using Minimal Data?
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Aug 13
Adaptation of Generalist Robot Policies with Minimal Data
arXiv:2608. 11363v1 Announce Type: cross Abstract: A central goal in robot learning is to move beyond task-specific human data collection toward robots that improve through autonomous interaction.
arXiv Machine Learning
Sep 21
From Pretraining to Proficiency: Real-World Subtask RL for Long-Horizon Manipulation with Minimal Human Intervention
The paper introduces PARTS, a real‑world subtask reinforcement learning framework that fine‑tunes a pretrained robot policy by focusing on critical bottleneck subtasks while keeping the base policy frozen. It uses agent‑generated selectors and success verifiers to provide local rewards, enabling learning even when full‑task successes are rare. Experiments on bimanual YAM and single‑arm Franka robots show that PARTS raises complete‑task success from 32% to 61% and from 50% to 95%, respectively, with only tens of minutes of real‑world RL rollouts and minimal human intervention.
arXiv AI
6d ago
Sample-Efficient Reinforcement Learning for Policy Improvement via Flow-Reversed Action Anchors
The paper introduces AnchorQ, a method that improves sample-efficient reinforcement learning for policy refinement by using flow-reversed action anchors. AnchorQ maps reference behaviors to state-conditioned latent anchors, samples local particles around these anchors, and employs value-guided sampling to explore promising refinements. Experiments on simulated and real-world manipulation tasks show that AnchorQ outperforms state-of-the-art post-training baselines, achieving a 37% higher real-world success rate and 97% greater simulated task throughput within the same interaction budget.
arXiv AI
Oct 12
OGPO: Offline Goal-conditioned Policy Optimization for Recoverable Vision-Language-Action Models
OGPO is an Offline Goal‑conditioned Policy Optimization framework designed to improve Vision‑Language‑Action (VLA) models for robotic manipulation. It replaces traditional step‑wise action imitation with adaptive relabeling of trajectories using semantic key states and goal‑conditioned rewards, enabling policies to reach task‑progress states even from off‑demonstration states. Experiments on LIBERO, MetaWorld, LIBERO‑Plus, and the proposed LIBERO‑ReAct benchmark show that OGPO consistently outperforms standard supervised fine‑tuning in terms of robustness and recoverability under distribution shifts.
arXiv AI
Jul 20
SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Training
arXiv:2506. 04147v5 Announce Type: replace-cross Abstract: Building capable household and industrial robots requires mastering the control of versatile, high-degree-of-freedom (DoF) systems such as mobile manipulators.
arXiv AI
Jun 11
Vision-Language-Action Jump-Starting for Reinforcement Learning Robotic Agents
arXiv:2604. 13733v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) enables high-frequency, closed-loop control for robotic manipulation, but scaling to long-horizon tasks with sparse or imperfect rewards remains difficult due to inefficient exploration and poor credit assignment.