arXiv Computation and Language By Yixuan Wang, Freda Shi, Kanishka Misra

Disentangling Statistical Preemption from Entrenchment in Language Models' Avoidance of Overgeneralization

Read the original on arXiv Computation and Language →

The paper investigates how language models avoid overgeneralizations by distinguishing between two types of indirect negative evidence: preemption and entrenchment. Through controlled rearing experiments on models trained on child‑caregiver conversations, the authors find that models do not exhibit verb‑specific preemption but show weak abstract preemption. Analysis of training dynamics suggests that competing structures act as indirect positive evidence rather than negative in the verb‑specific condition.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
5d ago

Patterns of Priming in Production: Lexical, Semantic and Structural Alignment in Language Model Generation

The paper studies structural priming in language model production by conducting controlled sentence‑completion experiments on dative constructions. Results show that language models exhibit priming effects, especially when sentences are semantically coherent, with stronger relative increases for double‑object datives and larger absolute increases for prepositional‑object datives. The study also finds that primed completions involve more lexico‑semantic repetition, indicating that priming operates across syntactic, lexical, and semantic levels.

By Giulia Pucci, Ruizhe Li, Arabella Sinclair