The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The paper presents a system for AI contact centers that answers questions only from a closed set of verified QA units, returning the unit verbatim or routing to clarification, abstention, or handoff. The index is enriched offline using staged linguistic seeding (SLS), where human-authored slot recipes are expanded by GPT‑4.1‑mini and lightly filtered by humans, enabling a single retrieval pass without query-time generation. On held‑out data from two industrial domains, SLS improves hybrid retrieval recall at rank 1 to 0.881/0.930 and outperforms doc2query by 0.20/0.32, while also reducing unsupported content from 7‑13% to near 0%.
arXiv:2608.30023v1 Announce Type: cross Abstract: Generative engines such as ChatGPT, Gemini, and Perplexity answer buyer questions directly and name a shortlist of brands inside the answer. Studying...
XTC (Exclude Top Choices) is a lightweight, head‑aware decoding operator that improves diversity in autoregressive language models by removing overly probable tokens that dominate the next‑token distribution. It works by identifying tokens above a plausibility threshold, probabilistically excluding the dominant choices, and renormalizing the remaining distribution. Across 60 experiments on models such as Gemma 3 and DeepSeek R1, XTC boosts Distinct‑2 scores by 11–15 % and cuts repeat trigrams by 27–47 %, while a Mechanical Turk study shows a 62.3 % preference for XTC‑generated text without loss of fluency.
arXiv:2607. 19794v1 Announce Type: cross Abstract: Production LLM-based financial sentiment analysis faces a structural cost trap: most queries are trivially classifiable, yet expensive cloud reasoners process them all, and the bill scales linearly with user count.
The study examines how 105 language models choose a single word from a large set of valid options, finding that 46% of the time they all pick the same word, "serendipity." Using 96 prompts that ask for one-word answers across various categories, the researchers measure convergence and each model’s share of the consensus. They observe that post‑training and persona‑tuned models diverge more, while heavily post‑trained assistants are more conformist, and that the field’s answer choices are more concentrated than human norms in most categories.
Standard decoding rules for autoregressive language models promote diversity by rescaling the full next-token distribution or truncating its low-probability tail. These strategies overlook a common re...