StateWise: Teaching Language Models to Track and Obey Evolving Constraints in Multi-Turn Dialogue

StateWise is a method that trains a single large language model to maintain and update its own constraint state during multi‑turn dialogue. By fine‑tuning the model to summarize conversations into a typed state with tombstones for revoked constraints and then self‑training on trajectories that pass exact round‑trip checks, it reduces relapse and improves conversation success. The approach outperforms a compiled‑ledger baseline on relapse without requiring inference‑time scaffolding, and it is evaluated on two backbones with held‑out constraint families and unseen phrasings.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• benchmarks