arXiv Machine Learning

Lagrangian Perturbation Diffusion Steering: Latent Reinforcement Learning for Generative Policies

arXiv:2606. 01151v1 Announce Type: new Abstract: Behavior cloning with high-capacity generative policies achieves strong imitation performance, but is often limited by demonstration coverage and distribution shift.

arXiv AI

6d ago

TMRL: Diffusion Timestep-Modulated Pretraining Enables Exploration for Efficient Policy Finetuning

arXiv:2605. 12236v2 Announce Type: replace-cross Abstract: Fine-tuning pre-trained robot policies with reinforcement learning (RL) often inherits the bottlenecks introduced by pre-training with behavioral cloning (BC), which produces narrow action distributions that lack the coverage necessary for downstream exploration.

By Matthew M. Hong, Jesse Zhang, Anusha Nagabandi, Abhishek Gupta

agents diffusion reinforcement-learning robotics fine-tuning

arXiv Machine Learning

Jun 10

MODIP: Efficient Model-Based Optimization for Diffusion Policies

arXiv:2606. 10825v1 Announce Type: new Abstract: Diffusion policies (DPs) have emerged as expressive policy representations for robot learning, often used with imitation learning methods such as behavioral cloning (BC).

By Zakariae El Asri, Philippe Gratias-Quiquandon, Nicolas Thome, Olivier Sigaud

diffusion reinforcement-learning robotics fine-tuning

arXiv Machine Learning

Jul 9

Latent Policy Steering through One-Step Flow Policies

arXiv:2603. 05296v2 Announce Type: replace-cross Abstract: Offline reinforcement learning (RL) allows robots to learn from offline datasets without risky exploration.

By Hokyun Im, Andrey Kolobov, Jianlong Fu, Youngwoon Lee

reinforcement-learning robotics efficiency benchmarks

arXiv AI

Jun 9

Latent Diffusion Policy: Shaping Latent Spaces for Diffusion-Based Robotic Manipulation

arXiv:2606. 08657v1 Announce Type: cross Abstract: Diffusion-based visuomotor policies operating directly in raw action spaces conflate scene comprehension with trajectory generation within a single denoising process.

By Zhexuan Zhou, Yichen Lai, Jinhao Zhang, Huizhe Li, Youmin Gong, Jie Mei

diffusion robotics

arXiv AI

Jun 2

Implicit Drifting Policy: One-Step Action Generation via Conditional Expert Geometry

arXiv:2606. 01098v1 Announce Type: cross Abstract: Generative action policies based on diffusion or flow matching excel in behavior cloning, yet their iterative sampling is prohibitive for high-frequency robot control.

By Zemin Yang, Yaoyu He, Yiming Zhong, Yuhao Zhang, Xinge Zhu, Yao Mu, Qingqiu Huang, Yuexin Ma

diffusion robotics efficiency

arXiv AI

Jun 16

Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equation

arXiv:2512. 07212v3 Announce Type: replace Abstract: Imitation learning with diffusion models has advanced robotic control by capturing the multi-modal action distributions.

By Zhaoyang Liu, Mokai Pan, Zhongyi Wang, Kaizhen Zhu, Haotao Lu, Haipeng Zhang, Jingya Wang, Ye Shi

diffusion robotics multimodal benchmarks

arXiv Machine Learning

Jul 13

FlowDAgger: Human-in-the-Loop Adaptation of Generative Robot Policies in Latent Space

arXiv:2607. 08877v1 Announce Type: cross Abstract: Pretrained generative robot policies based on flow matching and diffusion have achieved impressive results across a wide range of manipulation tasks.

By Michael Murray, Daphne Chen, Simran Bagaria, Dean Fortier, Tess Hellebrekers, Galen Mullins, Harshavardhan Gajarla, Oier Mees, Maya Cakmak, Andrey Kolobov

diffusion reinforcement-learning robotics fine-tuning

arXiv Machine Learning

Jun 17

Where Should Action Generation Begin? A Learnable Source Prior for Generative Robot Policies

arXiv:2606. 17408v1 Announce Type: cross Abstract: Generative robot policies typically begin action generation from an observation-independent standard Gaussian distribution, leaving the choice of source distribution underexplored.

By Meipo Dai, Qiyuan Zhuang, He-Yang Xu, Ying-Jie Shuai, Yijun Wang, Qi Dou, Xiu-Shen Wei

diffusion robotics

arXiv AI

Jun 9

Reinforcement Learning for Flow-Matching Policies with Density Transport

arXiv:2606. 08602v1 Announce Type: cross Abstract: We present an online reinforcement learning (RL) algorithm for fine-tuning flow-matching policies in continuous-control problems.

By Boshu Lei, Kostas Daniilidis, Antonio Loquercio

diffusion reinforcement-learning robotics fine-tuning efficiency multimodal safety

arXiv Machine Learning

Jun 8

GenPO++: Generative Policy Optimization with Jacobian-free Likelihood Ratios

arXiv:2606. 06967v1 Announce Type: new Abstract: Generative policies provide expressive and multimodal action distributions, making them attractive for reinforcement learning (RL) in complex continuous-control tasks.

By Ke Hu, Shutong Ding, Panxin Tao, Jingya Wang, Ye Shi

reinforcement-learning robotics fine-tuning multimodal benchmarks safety

arXiv AI

Jul 14

VINE: Taming Generative Control Policies for Reinforcement Learning

arXiv:2607. 10369v1 Announce Type: cross Abstract: Flow-matching policies have emerged as an effective policy parameterization for robot learning.

By Rushuai Yang, Zhuo Han, Houlin Li, Hecheng Wang, Zhichao Wu, Rui Zhang, Zhaowei Zhang, Zihong Chen, Xiaohan Yan, Chiming Liu, Yi Chen, Wei Shan, Maoqing Yao

reinforcement-learning robotics multimodal benchmarks

arXiv AI

Jun 2

ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors

arXiv:2603. 15956v3 Announce Type: replace-cross Abstract: Learning generalizable and robust behavior cloning policies requires large volumes of high-quality robotics data.

By Zifan Xu, Ran Gong, Maria Vittoria Minniti, Kausik Sivakumar, Ahmet Salih Gundogdu, Eric Rosen, Riedana Yan, Tushar Kusnur, Zixing Wang, Di Deng, Peter Stone, Xiaohan Zhang, Karl Schmeckpeper

llms diffusion reinforcement-learning robotics benchmarks

Related stories