arXiv AI
Steering Generative Robot Policies with Lexicographic Preferences
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 11
OGPO: Sample Efficient Full-Finetuning of Generative Control Policies
arXiv:2605. 03065v2 Announce Type: replace Abstract: Generative control policies (GCPs), such as diffusion- and flow-based control policies, have emerged as effective parameterizations for robot learning.
arXiv Machine Learning
Sep 15
VGFM: Expressive Robot Policies via Dense Value Guidance in Flow Matching
arXiv:2609.14261v1 Announce Type: cross Abstract: Recent robot learning paradigms increasingly rely on large offline datasets of robotic interactions to train control policies. Expressive generative...
arXiv AI
3d ago
PrefPI: Preference-Guided Steering into Out-of-Distribution Behaviors
PrefPI (Preference-Guided Policy Iteration) is an iterative framework that steers pretrained generative robot policies using only relative preferences over self-generated trajectories. It treats preference learning as preference-conditioned generative modeling, where preferred trajectories define a conditional distribution whose density ratio with the broader behavior prior yields an implicit preference signal amplified by classifier-free guidance (CFG). By repeatedly applying this preference-conditioned modeling and guidance, PrefPI iteratively improves policies, enabling access to behaviors that were rarely or never observed under the initial policy, and achieves significant behavioral shifts such as increasing object transport height from 10.7 cm to 19.8 cm on real hardware with only 150 preference-labeled trajectories.
arXiv Machine Learning
Jun 29
Support-Constrained RL Enables Real-World Policy Improvement without Real-World Experience
arXiv:2606. 27475v1 Announce Type: cross Abstract: Robots trained on real world data tend to be imprecise, slow, and brittle to perturbations.
Hugging Face Trending Papers
Aug 20
RoMAN-Flow: Taming Autoregressive Normalizing Flows for Offline Reinforcement Learning in Robotic Manipulation
Offline reinforcement learning improves robotic policies using previously collected data without further environment interaction. Yet prevalent diffusion- and flow-matching robot policies lack tractable likelihoods, limiting their use in likelihood-based offline RL post-training.
arXiv Computer Vision
Aug 21
RoMAN-Flow: Taming Autoregressive Normalizing Flows for Offline Reinforcement Learning in Robotic Manipulation
arXiv:2608. 20208v1 Announce Type: new Abstract: Offline reinforcement learning improves robotic policies using previously collected data without further environment interaction.