arXiv Machine Learning

Doob-Based Generative Policy Optimization

Doob-Based Generative Policy Optimization (DoobPO) introduces a likelihood‑free framework for fine‑tuning generative policies such as diffusion and flow models. It first learns a lightweight ratio model to represent the desired policy update and then distills this ratio‑tilted target policy into the generative policy via conditional drift matching. The method supports standard policy improvement rules like PPO and GRPO, proves gradient equivalence to an ideal Doob drift matching objective, and demonstrates strong performance on MuJoCo continuous‑control benchmarks.

arXiv Machine Learning

Sep 15

VGFM: Expressive Robot Policies via Dense Value Guidance in Flow Matching

arXiv:2609.14261v1 Announce Type: cross Abstract: Recent robot learning paradigms increasingly rely on large offline datasets of robotic interactions to train control policies. Expressive generative...

By Prajwal Koirala, Mark Campbell

diffusion reinforcement-learning robotics efficiency multimodal

arXiv AI

Oct 15

A Survey of Flow Matching in Reinforcement Learning

arXiv:2610.16275v1 Announce Type: cross Abstract: Flow Matching (FM) has recently emerged as a principled and efficient generative modeling framework for reinforcement learning (RL), enabling express...

By Nabuat Zaman Nahim, Fairoz Nower Khan, Peizhong Ju

diffusion reinforcement-learning fine-tuning efficiency multimodal safety

arXiv Machine Learning

Jun 8

GenPO++: Generative Policy Optimization with Jacobian-free Likelihood Ratios

arXiv:2606. 06967v1 Announce Type: new Abstract: Generative policies provide expressive and multimodal action distributions, making them attractive for reinforcement learning (RL) in complex continuous-control tasks.

By Ke Hu, Shutong Ding, Panxin Tao, Jingya Wang, Ye Shi

reinforcement-learning robotics fine-tuning multimodal benchmarks safety

arXiv AI

Jun 9

Reinforcement Learning for Flow-Matching Policies with Density Transport

arXiv:2606. 08602v1 Announce Type: cross Abstract: We present an online reinforcement learning (RL) algorithm for fine-tuning flow-matching policies in continuous-control problems.

By Boshu Lei, Kostas Daniilidis, Antonio Loquercio

diffusion reinforcement-learning robotics fine-tuning efficiency multimodal safety

arXiv Machine Learning

Jun 2

Mean Flow Policy Optimization

arXiv:2604. 14698v2 Announce Type: replace Abstract: Diffusion models have recently emerged as expressive policy representations for online reinforcement learning (RL).

By Xiaoyi Dong, Xi Sheryl Zhang, Jian Cheng

diffusion reinforcement-learning benchmarks

arXiv Machine Learning

Jun 11

OGPO: Sample Efficient Full-Finetuning of Generative Control Policies

arXiv:2605. 03065v2 Announce Type: replace Abstract: Generative control policies (GCPs), such as diffusion- and flow-based control policies, have emerged as effective parameterizations for robot learning.

By Sarvesh Patil, Mitsuhiko Nakamoto, Manan Agarwal, Shashwat Saxena, Jesse Zhang, Giri Anantharaman, Cleah Winston, Chaoyi Pan, Douglas Chen, Nai-Chieh Huang, Zeynep Temel, Oliver Kroemer, Sergey Levine, Abhishek Gupta, Hongkai Dai, Paarth Shah, Max Simchowitz

diffusion reinforcement-learning robotics fine-tuning benchmarks

arXiv Machine Learning

Jun 10

MODIP: Efficient Model-Based Optimization for Diffusion Policies

arXiv:2606. 10825v1 Announce Type: new Abstract: Diffusion policies (DPs) have emerged as expressive policy representations for robot learning, often used with imitation learning methods such as behavioral cloning (BC).

By Zakariae El Asri, Philippe Gratias-Quiquandon, Nicolas Thome, Olivier Sigaud

diffusion reinforcement-learning robotics fine-tuning

arXiv Machine Learning

Oct 15

Generative Actor-Critic with Soft Bridge Policies

arXiv:2605.08733v2 Announce Type: replace Abstract: Expressive generative policies such as diffusion and flow models are appealing for maximum-entropy (MaxEnt) online reinforcement learning because o...

By Ke He, Le He, Shunpu Tang, Yafei Wang, Lisheng Fan

diffusion reinforcement-learning multimodal benchmarks

arXiv AI

Jul 14

VINE: Taming Generative Control Policies for Reinforcement Learning

arXiv:2607. 10369v1 Announce Type: cross Abstract: Flow-matching policies have emerged as an effective policy parameterization for robot learning.

By Rushuai Yang, Zhuo Han, Houlin Li, Hecheng Wang, Zhichao Wu, Rui Zhang, Zhaowei Zhang, Zihong Chen, Xiaohan Yan, Chiming Liu, Yi Chen, Wei Shan, Maoqing Yao

reinforcement-learning robotics multimodal benchmarks

arXiv Machine Learning

Jun 2

Lagrangian Perturbation Diffusion Steering: Latent Reinforcement Learning for Generative Policies

arXiv:2606. 01151v1 Announce Type: new Abstract: Behavior cloning with high-capacity generative policies achieves strong imitation performance, but is often limited by demonstration coverage and distribution shift.

By Hikmet Simsir, Ozgur S. Oguz

diffusion reinforcement-learning robotics fine-tuning multimodal benchmarks

arXiv AI

Jun 16

Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equation

arXiv:2512. 07212v3 Announce Type: replace Abstract: Imitation learning with diffusion models has advanced robotic control by capturing the multi-modal action distributions.

By Zhaoyang Liu, Mokai Pan, Zhongyi Wang, Kaizhen Zhu, Haotao Lu, Haipeng Zhang, Jingya Wang, Ye Shi

diffusion robotics multimodal benchmarks

arXiv Machine Learning

Jun 17

Where Should Action Generation Begin? A Learnable Source Prior for Generative Robot Policies

arXiv:2606. 17408v1 Announce Type: cross Abstract: Generative robot policies typically begin action generation from an observation-independent standard Gaussian distribution, leaving the choice of source distribution underexplored.

By Meipo Dai, Qiyuan Zhuang, He-Yang Xu, Ying-Jie Shuai, Yijun Wang, Qi Dou, Xiu-Shen Wei

diffusion robotics

Related stories