arXiv AI By Fariba Dehghan, Sebastian Stein, Vahid Yazdanpanah, Stephanie Gauthier

Strategyproof Deep Reinforcement Learning for Online Resource Allocation

Read the original on arXiv AI →

The paper introduces the first strategyproof deep reinforcement learning mechanism for online resource allocation, combining a monotonic neural network, a generalized critical payment rule, and training via RL or imitation. This design ensures truthful reporting and individual rationality while capturing nonlinear resource interactions beyond linear models. Experiments on a four‑resource stream show the neural rule attains 97.8% of an offline welfare upper bound, outperforming linear learners and first‑come, first‑served baselines, and imitation training achieves comparable performance 89 times faster than RL.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 15

ProAS: A Progress-Aware Advantage Shaping Framework for Multi-Turn Agentic Reinforcement Learning

The paper introduces ProAS, a Progress‑Aware Advantage Shaping framework designed to improve critic‑free reinforcement learning for large language model agents. ProAS uses a dynamic Agentic Reference Graph to provide fine‑grained credit assignment through Masking Unreasonable Incentives and Asymmetric Penalty Redistribution, avoiding the uniform advantage broadcast that can reinforce invalid actions. Experiments on Qwen2.5‑1.5B‑Instruct and Qwen2.5‑7B‑Instruct show that ProAS raises baseline success rates to 91.9% and 94.3% on ALFWorld and 66.7% and 70.8% on WebShop, while speeding up training convergence up to 2.44× and remaining robust to imperfect reference graphs.

By Bowen Ding, Mingda Wan, Yuhan Chen, Jiyao Yuan, Qi Zhu, Futing Wang, Heyuan Deng, Fei Mi, Lifeng Shang, Tao Lin