arXiv Machine Learning By Ziyad Sheebaelhamd, Luca Viano, Volkan Cevher, Claire Vernade

Split the Differences, Pool the Rest: Provably Efficient Multi-Objective Imitation

Read the original on arXiv Machine Learning →

This paper tackles multi‑objective imitation learning, aiming to recover policies on the Pareto front from demonstrations by multiple Pareto‑optimal experts in a Multi‑Objective Markov Decision Process. The authors propose Multi‑Output Augmented Behavioral Cloning (MA‑BC), which partitions divergent expert data and pools non‑conflicting state‑action pairs, proving that MA‑BC converges to Pareto‑optimal policies faster than independent‑dataset learners and is minimax optimal. Experiments on diverse discrete environments and a continuous Linear Quadratic Regulator confirm the algorithm’s effectiveness.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 30

Provable Benefits of Regularization: Fast Rates for Adversarial Imitation Learning

The paper introduces Dually Regularized AIL, a model‑free algorithm for adversarial imitation learning that jointly applies KL policy regularization and a quadratic reward penalty based on expert and learner occupancies. It proves fast convergence rates, achieving a ×O(1/K+1/N) bound on the regularized imitation gap in finite‑horizon MDPs with general function approximation, and establishes the first algorithm to attain ×O(1/ε) sample complexity in both expert demonstrations and online interactions for this regularized objective.

By Hanbin Zhou, Shangzhe Li, Alexander Braverman, Weitong Zhang
arXiv Machine Learning
Jun 2

Coherent Off-Policy Improvement of Large Behavior Models with Learned Rewards

arXiv:2606. 02194v1 Announce Type: new Abstract: Distilling expert demonstration data into large generative models using behavioral cloning is a scalable approach to learning capable policies for robotic control, particularly for dexterous manipulation.

By Christian Scherer, Joe Watson, Theo Gruner, Daniel Palenicek, Ingmar Posner, Jan Peters