The Flow has not summarised this story yet — read it at arXiv Computation and Language.
arXiv:2606. 30815v1 Announce Type: cross Abstract: Recent work suggests that transformer language models show a bias towards human languages over unnatural ("impossible") languages argued to be unacquirable by humans.
Large language models increasingly produce and interpret verbal probability expressions, yet whether these expressions carry consistent meaning across models (or match human perceptions of uncertainty...
The study evaluates how large language models (LLMs) interpret verbal probability expressions by mapping words to numbers and testing consistency across 19 models. Results show that LLMs largely mirror human benchmarks—preserving word order, recovering key anchor points, and reflecting the high variance of the term "possible"—but they exhibit a systematic upward bias for negative expressions like "unlikely" and "improbable." Explanation elicitation reduces within‑model variance but increases divergence between models, while a bidirectional roundtrip test reveals that leading models maintain coherent internal representations.
As the chain-of-thought reasoning capabilities of large language models improve, evaluating and calibrating their reasoning confidence is becoming increasingly important for quantifying the uncertaint...
The paper investigates how large language models (LLMs) handle two usage‑based grammatical strategies: coercion, where a mismatched word is reinterpreted to fit its context, and preemption, where a plausible structure is avoided because it never appears in expected contexts. Experiments across models of varying sizes show that larger LLMs successfully recognize and produce constructional productivity in coercive situations, even with novel words, but they fail to exhibit preemptive behavior, lacking the negative evidence that would guide avoidance of unconventional but semantically viable constructions. The authors argue that coercion is detectable due to its surprising, semantically motivated nature, whereas preemption lacks such a signature, leading to an asymmetry where models coerce but do not preempt.
arXiv:2604. 14180v2 Announce Type: replace-cross Abstract: We train a 318M-parameter Transformer language model from scratch on a curated corpus of 1.