arXiv Machine Learning

Multi-agent imitation learning with function approximation: Linear Markov games and beyond

arXiv:2602. 22810v2 Announce Type: replace Abstract: In this work, we present the first theoretical analysis of multi-agent imitation learning (MAIL) in linear Markov games where both the transition dynamics and each agent's reward function are linear in some given features.

arXiv Machine Learning
Jul 1

End-to-End Efficient RL for Linear Bellman Complete MDPs with Deterministic Transitions

arXiv:2603. 23461v2 Announce Type: replace Abstract: We study reinforcement learning (RL) with linear function approximation in Markov Decision Processes (MDPs) satisfying \emph{linear Bellman completeness} -- a fundamental setting where the Bellman backup of any linear value function remains linear.

By Zakaria Mhammedi, Alexander Rakhlin, Nneka Okolo
arXiv Machine Learning
2d ago

Making Strides in Symbolic Imitation Learning: Offline Demonstrations, Online Tuning

The paper introduces Symbolic Imitation Learning, a framework that distills an oracle policy from an offline dataset into a decision list using linear model motion primitives. By combining this with online Augmented‑Random Search tuning, the resulting interpretable policies match or surpass the oracle’s performance on 20 benchmark reinforcement learning tasks. The approach yields concise, understandable policies that domain experts can readily interpret.

By Bryce MacInnis, Malcolm I. Heywood
arXiv Machine Learning
Oct 15

Split the Differences, Pool the Rest: Provably Efficient Multi-Objective Imitation

This paper tackles multi‑objective imitation learning, aiming to recover policies on the Pareto front from demonstrations by multiple Pareto‑optimal experts in a Multi‑Objective Markov Decision Process. The authors propose Multi‑Output Augmented Behavioral Cloning (MA‑BC), which partitions divergent expert data and pools non‑conflicting state‑action pairs, proving that MA‑BC converges to Pareto‑optimal policies faster than independent‑dataset learners and is minimax optimal. Experiments on diverse discrete environments and a continuous Linear Quadratic Regulator confirm the algorithm’s effectiveness.

By Ziyad Sheebaelhamd, Luca Viano, Volkan Cevher, Claire Vernade