TPBench: A Turning-Point Benchmark for Dialogue Compression

TPBench is a benchmark for dialogue compression that focuses on turning-point eviction, where a user’s change in intent or constraints is lost during compression. It evaluates three information targets—initial user goal, current slot value after revision, and both together—using existing dialogue-state annotations from MultiWOZ and SGD, without requiring new crowdsourcing. The benchmark shows that different compression methods rank differently across probes, and that deleting the turn containing a user update significantly harms current-value accuracy, while removing irrelevant turns does not.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• benchmarks