arXiv Machine Learning
Sep 2

Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPC

The paper introduces Solver-Gradient Guided Reinforcement Learning (SG‑RL), a method that augments standard RL with bounded gradients from a differentiable MPC solver to adapt cost‑function weights online. SG‑RL integrates solver‑gradient guidance into PPO through actor‑update scaling, policy loss, advantage estimation, and value‑function learning, achieving comparable or superior closed‑loop performance while requiring up to 70.6% fewer samples. Experiments on two autonomous racing platforms with intentional model mismatch demonstrate that SG‑RL outperforms both RL and gradient‑based policy learning baselines and generalizes zero‑shot to unseen environments.

By Baha Zarrouki, Arslan Thobani, Jasper Hoffmann, Mattia Piccinini, Rudolf Reiter, Felix Jahncke, S\'ebastien Gros, Davide Scaramuzza, Johannes Betz
arXiv AI
Sep 17

Language-Guided Terrain-Adaptive Neural MPC for Autonomous Traversal of Articulated Tracked Robots

The paper introduces ASTRIL-MPC, a language‑guided neural model predictive control framework that enables articulated tracked robots to navigate complex, contact‑rich urban environments such as stairwells and cluttered interiors. By combining a learned kinematics model that predicts short‑horizon state changes, an optimization‑based planner with multi‑objective costs, and a large language model that safely updates control weights, the system achieves up to 71% better traversal quality than non‑adaptive NMPC and 67% better than a PPO baseline, while eliminating collision impacts during descent. Real‑robot trials over four indoor obstacles confirm the method’s transferability to physical contact‑rich traversal.

By Zhenfeng Gan, Yanbo Chen, Lirong Che, Yongyi Ma, Rongkai Zhu, Xueqian Wang