arXiv Computation and Language
Implicit Beliefs as Scalable Process Rewards for Strategic Persuasion
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv AI
Jun 4
Unlocking Proactivity in Task-Oriented Dialogue
arXiv:2605. 22240v2 Announce Type: replace Abstract: Proactive task-oriented dialogue (TOD), such as outbound sales, demands a persuasive agent that actively probes the user's concerns and steers the conversation toward acceptance within a bounded number of turns.
arXiv AI
Sep 25
Beyond Surface Style: Aligning Multi-Turn User Simulators with Behavioral Consistency
The paper introduces TRACER, a multi‑turn user simulator that models evolving user intent and aligns simulated behavior with real interaction trajectories. TRACER is trained first with supervised fine‑tuning on real dialogues and then with reinforcement learning that uses hierarchical outcome‑ and trajectory‑level rewards to address reward sparsity and credit assignment. In real customer‑service sessions, TRACER‑7B outperforms the best baseline by 11.4 conversion F1, achieves the lowest group‑level conversion‑rate error and semantic trajectory distance, and generalizes to out‑of‑distribution scenarios, while human Turing tests show its conversations appear natural. The authors also present the Dynamic Marketing Benchmark, which evaluates both persuasion effectiveness and response quality of large language models through simulated interactions, demonstrating that higher response quality does not always lead to higher conversion rates.
arXiv AI
Jun 6
A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracing
arXiv:2606. 05330v1 Announce Type: cross Abstract: Large language models can shift human beliefs across high-stakes domains, but most persuasion studies rely on pre/post belief change.
arXiv Computation and Language
Sep 1
Make an Offer They Can't Refuse: Grounding Bayesian Persuasion in Real-World Dialogues without Pre-Commitment
arXiv:2510.13387v3 Announce Type: replace Abstract: Large language models (LLMs) still struggle with strategic persuasion, largely because existing approaches either neglect information asymmetry or...
arXiv Computation and Language
3d ago
Profile-Driven User Simulation via Reinforcement Learning with Hierarchical Rewards for Task-Oriented Dialogues
ProfileSim is a profile‑driven user simulation framework designed for financial marketing outbound calls. It jointly models user demographics, Big Five personality traits, and business intents reverse‑engineered from real call logs, allowing fine‑grained control over simulated behavior. The system is fine‑tuned on real voice dialogue data and further refined with Group Relative Policy Optimization using hierarchical rewards, achieving high colloquial naturalness, strong user profile adherence, and low agent scores on long‑tail intents while producing shorter user utterances.
arXiv Computation and Language
Sep 4
RL-ADA: A World-Feedback Framework for Adversarially Robust Enterprise Dialogue Agents
RL-ADA introduces a co‑evolutionary training framework that replaces costly human annotations with world‑feedback rewards derived from interaction outcomes. In this system, a large Customer Support Agent and an Adversarial Customer Agent train together, guided by an automated judge that rewards successful resolution and realistic intent‑concealing utterances, respectively. Applied to a banking support proof of concept, the method eliminates routing errors and doubles the end‑to‑end PASS rate over five cycles, while also revealing a new adversarial strategy called Contextual Camouflage.