VGFM: Expressive Robot Policies via Dense Value Guidance in Flow Matching
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2607. 10369v1 Announce Type: cross Abstract: Flow-matching policies have emerged as an effective policy parameterization for robot learning.
arXiv:2603. 05296v2 Announce Type: replace-cross Abstract: Offline reinforcement learning (RL) allows robots to learn from offline datasets without risky exploration.
arXiv:2606. 06967v1 Announce Type: new Abstract: Generative policies provide expressive and multimodal action distributions, making them attractive for reinforcement learning (RL) in complex continuous-control tasks.
arXiv:2606. 11087v1 Announce Type: cross Abstract: Expressive continuous control policies, such as diffusion and flow models, form the backbone of recent advances in scaling imitation learning for simulated and real robot control.
The paper introduces AnchorQ, a method that improves sample-efficient reinforcement learning for policy refinement by using flow-reversed action anchors. AnchorQ maps reference behaviors to state-conditioned latent anchors, samples local particles around these anchors, and employs value-guided sampling to explore promising refinements. Experiments on simulated and real-world manipulation tasks show that AnchorQ outperforms state-of-the-art post-training baselines, achieving a 37% higher real-world success rate and 97% greater simulated task throughput within the same interaction budget.
arXiv:2605. 03065v2 Announce Type: replace Abstract: Generative control policies (GCPs), such as diffusion- and flow-based control policies, have emerged as effective parameterizations for robot learning.