← Back to all news
arXiv Computation and Language By Syed Mahbubul Huq, Pranava Madhyastha

First Make It Playable, Then Make It Good: Staged Interaction Learning for Small Dialogue-Game Agents

Read the original on arXiv Computation and Language →

The paper introduces Qwen-GuidePlay-2B, a 2B‑parameter language model fine‑tuned for dialogue‑game interaction. The training pipeline consists of three stages: supervised fine‑tuning on successful game trajectories, weighted turn‑level fine‑tuning, and teacher‑guided fine‑tuning that corrects formatting and evaluates examples. The resulting model achieves a clemscore of 57.12 and a statscore of 42.68 on Playpen’s public validation, ranking second in the official challenge and demonstrating that careful curation can outperform more aggressive procedural methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Related stories

arXiv Machine Learning
Aug 31

Acquire, Repair, Preserve: A Diagnosis-Guided Post-Training Recipe for Small-Model Dialogue Game Agents

The paper presents a post‑training recipe for small dialogue‑game agents that involves three steps: acquiring broad game participation via supervised fine‑tuning, repairing specific local failures with turn‑local preference pairs, and preserving general capabilities. Applied to the LM Playschool Challenge, the method raises the public clemscore from 10.67 to 38.92 and the closed in‑domain score from 13.41 to 41.17 while keeping overall static performance nearly unchanged. The gains are mainly within the targeted game family, with limited improvement on out‑of‑domain clemscore.

By Nan Li
agentsfine-tuningbenchmarks
More like this →
arXiv AI
Jul 29

CAST: Game Solvers as Turn-Level Teachers for LLM Agents

arXiv:2607. 25308v1 Announce Type: cross Abstract: Training large language models (LLMs) to act in long-horizon games is a promising step toward generalist decision-making, yet reinforcement learning with verifiable rewards (RLVR) relies on sparse final rewards that reveal little about which decisions determine success.

By Yu Wang, Yi-Kai Zhang, Wentao Shi, Ziang Ye, Yuchun Miao, Yueqing Sun, Qi Gu, Xunliang Cai, Lan-Zhe Guo, Han-Jia Ye, Fuli Feng
llmsagentsreinforcement-learningefficiency
More like this →
arXiv Computation and Language
Oct 16

Stop Training Against Soft Users: Mentalized Adversarial Self-Play for Proactive Dialogue

The paper introduces Mentalized Adversarial Self-Play (MASP), a framework for training proactive dialogue agents by modeling the user as a rationally resisting participant with an evolving mental state. MASP separates teacher and student mentalization, alternates self‑play updates for system and user policies, and treats robustness to rational resistance as a training objective. Experiments on proactive dialogue benchmarks show MASP improves success rate, rationality‑constrained success, reduces average turns, and performs better against hard users compared to SFT and Planner‑only approaches.

By Zanwu Liu, Dan Zhang, Xiaodi Wang, Yongbo Mao, Xiaoyang Guo, Yonglin Wu, Peiyue Jiang, Yangyang Wei, Zecheng Lin
agentsreinforcement-learningfine-tuningbenchmarkssafety
More like this →