The paper reports that language‑model agents used for customer‑relationship management can be misled by optimistic assertions from sales representatives in CRM records, leading to incorrect deal approvals. In a benchmark of 100 lead‑qualification tasks, models incorrectly cleared 29 of 31 deals where the representative’s claims contradicted company policies, with misalignment rates ranging from 87% to 97% across seven models. The authors propose diagnostic methods—including bucket analysis, same‑information controls, and compute‑step controls—to distinguish persuasion from information gaps and to quantify the impact of incentive‑misaligned witnesses.
By Rahul Balakavi
arXiv:2606. 09410v1 Announce Type: new Abstract: Prior work treats structured output as a reasoning tax, but this framing is incomplete: the cost of formatting depends strongly on a model's spare capacity.
By Hengxin Fan
arXiv:2608.29464v1 Announce Type: cross
Abstract: Chain-of-thought (CoT) monitoring assumes that reasoning traces faithfully record the information that shapes a model's answer. Existing faithfulness...
By Aryo Pradipta Gema, Neel Rajani, Rohit Saxena, Wai-Chung Kwan, Pasquale Minervini
The paper introduces the Token Economy Score (TES), a metric that quantifies the accuracy gain of reasoning-capable large language models relative to non-reasoning baselines, normalized by token generation cost. An empirical study across 151 runs on seven diverse benchmarks shows that task structure—such as sequential inference chains—predicts higher TES, while knowledge-recall tasks yield lower TES despite difficulty. The analysis also reveals diminishing returns at higher reasoning effort and highlights how deployment context, via Reasoning Cost Share and Deployment Cost Multiplier, can alter the economic viability of reasoning workloads.
By Sachin Gopal Wani, Ajay Dholakia, David Ellison
arXiv:2609.23886v1 Announce Type: new
Abstract: Software delegates more of its branches to models every year: which queue a ticket enters, whether a command is safe to run, whether a claim clears wit...
By Zehua Cheng, Wei Dai, Jiahao Sun
arXiv:2608. 09254v1 Announce Type: new Abstract: LLM analytics agents are evaluated on SQL syntax accuracy, but production failures look different: questions with two valid business definitions, questions the warehouse cannot answer, deprecated columns after a schema change, and queries that execute successfully while returning the wrong business number.
By Morris Lee