arXiv AI

Post-training for Efficient Communication via Convention Formation

arXiv:2508. 06482v2 Announce Type: replace-cross Abstract: Humans communicate with increasing efficiency in multi-turn interactions, by adapting their language and forming ad-hoc conventions.

arXiv AI
2d ago

Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer

The paper investigates how to adapt large language models to mimic an individual author's style using only a few example abstracts, a task made harder by the formal nature of scientific writing. It proposes three style‑conditioning methods—contrastive activation steering, a network predicting steering vectors, and a hypernetwork predicting LoRA adapters—and finds that while fine‑tuning captures the strongest style signal, it harms fluency; the hypernetwork offers the best balance between style imitation and output quality for both seen and unseen authors. The authors also show that steering can be performed at the author level by contrasting author abstracts against style‑neutral generations for the same content, eliminating the need for a predefined style inventory and outperforming inventory‑based approaches. whyItMatters":"The study provides practical techniques for author‑style transfer in scientific writing, revealing a trade‑off between style fidelity and fluency and demonstrating that hypernetworks can effectively balance these aspects."

By Leonard Popp, Danni Liu, Supriti Sinhamahapatra, Jan Niehues
arXiv Machine Learning
Jul 9

Towards Understanding Steering Strength

arXiv:2602. 02712v2 Announce Type: replace Abstract: A popular approach to post-training control of large language models (LLMs) is the steering of intermediate latent representations.

By Magamed Taimeskhanov, Samuel Vaiter, Damien Garreau
arXiv Computation and Language
Sep 1

DuplexGen: Adaptive Synthesis of Human-AI Turn-Taking Dialogues

arXiv:2607.26178v2 Announce Type: replace Abstract: Turn-taking is a central component of full-duplex interaction. Which turn-taking behaviors are appropriate varies with the scenario, yet current mo...

By Takyoung Kim, Kang-wook Kim, Sang Hoon Woo, Julia Hirschberg, Gunhee Kim, Dilek Hakkani-T\"ur
arXiv Machine Learning
Sep 18

Sampling Reveals Style: Unsupervised, Training-Free Discovery of Prompt-Conditional Stylistic Axes in LLM Activations

The paper introduces a training‑free method for uncovering prompt‑conditional stylistic axes in large language models (LLMs). By repeatedly sampling completions of a single prompt at high temperature and applying Principal Component Analysis (PCA) to the pooled hidden activations, the authors automatically label the resulting axes using the extreme (pole) generations. Validation against 245 human‑elicited stylistic annotations shows that, for the Qwen‑3.5‑4B‑Instruct model, the top two axes align with human dimensions with 72.8% precision and 43.6% macro‑recall, and 75.6% of validity ratings confirm the axes’ polar generations, while other models exhibit varying degrees of discoverability.

By Ajit Mallavarapu, Ziwei Gu