The paper introduces the concept of behavioral couplings, where fine‑tuning a large language model on one behavior can unintentionally trigger another related behavior. By training on documents that pair distinct behaviors, the authors show that fine‑tuning to elicit one behavior causes the other to emerge, and that couplings can compose across multiple document sets. These findings highlight that unintended behaviors can surface after fine‑tuning and may be difficult to trace back to their origins.
By Dongyoon Hahm, Woogyeol Jin, Dennis Wei, Yi Zhou, Nathalie Baracaldo, Kimin Lee
The paper demonstrates that a prompt’s influence is not inherent to the prompt itself but depends on the model, as prompts optimized for one model degrade on another and rankings shift under neutral reformatting. By examining a task‑free structural readout—specifically the fixed‑point behavior of a short‑window argmax map—the authors show that nine tokens of conditioning can move the fixed‑point fraction across most of its range, altering structural classes and model rankings, while instruction tuning has no effect. Attempts to explain this phenomenon through prefix length, content type, bidirectionality, or attention‑sink dominance all fail, indicating that the prompt‑model pair is the fundamental unit of explanation.
whyItMatters":"The study reveals that prompt effectiveness is model‑specific and that simple structural readouts can capture this interaction, challenging assumptions about prompt generality and guiding future prompt‑engineering efforts."
By Nicol\'as Vera Z\'u\~niga
arXiv:2608. 19893v1 Announce Type: cross Abstract: Where does the novelty a base language model produces with no task come from, and what can an LLM judge of a long stream actually see?
By Roberto I. Ono Filho
The study turns the speculative field of astrolinguistics into an experiment by using two large language models with deliberately incompatible constructed lexicons as informants. A scripted orchestrator translates between the two category systems, and a protocol combining cross‑situational elimination, predictive probes, active scene selection, and a stricter recovery round successfully prevents the ‘kangaroo effect’—the silent attachment of a word to the wrong referent—in over 400 simulated and live runs. When informant noise is introduced, the protocol remains robust up to 2% per‑word noise and largely abstains rather than errs at higher noise levels, while a generate‑and‑test loop allows recovery of words outside the scripted hypothesis space, achieving full coverage as the rule‑proposing LLM’s capability increases.
whyItMatters":"The protocol demonstrates that experimental astrolinguistics can reliably avoid mistranslations and recover unknown terms, showing that correctness is governed by the protocol while coverage depends on the instruments used."
By Francesco Cordella, Mauro Cappelli
The paper investigates how periodic subject changes—termed interruptions—affect the perceived novelty and coherence of text generated by base language models. By inserting a new subject every few hundred tokens into a stream that otherwise repeats, the authors find that judged surprise increases by 1.2 to 1.4 points and connection by 0.8 points compared to habituation alone. The study also reports that such interruptions do not produce integrated documents, and that the effect is robust across different models and evaluation protocols.
arXiv:2606. 07555v1 Announce Type: cross Abstract: Glossaries, technical specifications, and system prompts routinely ask language models to use familiar words in unfamiliar ways.
By Han-yu Wang