arXiv Machine Learning By Denis Blessing, Onur Celik, Gerhard Neumann

Reinforcement Learning via Fixed-point Flow Matching

Read the original on arXiv Machine Learning →

The paper introduces fixed‑point flow matching (FFM), a data‑free method for training and fine‑tuning flow policies in reinforcement learning. FFM formulates the actor update as a fixed‑point iteration using a flow‑matching regression objective, where the critic’s action gradients act as targets. Experiments show that FFM can effectively fine‑tune pretrained flow policies in offline‑to‑online scenarios and train flow policies from scratch in online RL, establishing it as a principled approach for learning expressive flow‑based policies without training data.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 2

Flowing Faster to Coordinate: One-Step Online Multi-Agent Flow Policies

The paper introduces OMAF, an Online MARL framework that uses a one-step Transformer-based flow policy to generate coordinated actions efficiently. By replacing costly iterative sampling with a single-step action generation and a joint optimization scheme that couples softmax Q-value estimation with flow policy objectives, OMAF maintains expressive multimodal behavior while improving training speed. Experiments on 10 tasks from MPE and MAMuJoCo demonstrate up to 3.4× higher returns and 10.5× better sample efficiency compared to baseline methods.

By Zhuoran Li, Yunzhan Li, Xun Wang, Yihan Du, Longbo Huang