arXiv Machine Learning By Ajit Mallavarapu, Ziwei Gu

Sampling Reveals Style: Unsupervised, Training-Free Discovery of Prompt-Conditional Stylistic Axes in LLM Activations

Read the original on arXiv Machine Learning →

The paper introduces a training‑free method for uncovering prompt‑conditional stylistic axes in large language models (LLMs). By repeatedly sampling completions of a single prompt at high temperature and applying Principal Component Analysis (PCA) to the pooled hidden activations, the authors automatically label the resulting axes using the extreme (pole) generations. Validation against 245 human‑elicited stylistic annotations shows that, for the Qwen‑3.5‑4B‑Instruct model, the top two axes align with human dimensions with 72.8% precision and 43.6% macro‑recall, and 75.6% of validity ratings confirm the axes’ polar generations, while other models exhibit varying degrees of discoverability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 5

Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer

The paper investigates how to adapt large language models to mimic an individual author's style using only a few example abstracts, a task made harder by the formal nature of scientific writing. It proposes three style‑conditioning methods—contrastive activation steering, a network predicting steering vectors, and a hypernetwork predicting LoRA adapters—and finds that while fine‑tuning captures the strongest style signal, it harms fluency; the hypernetwork offers the best balance between style imitation and output quality for both seen and unseen authors. The authors also show that steering can be performed at the author level by contrasting author abstracts against style‑neutral generations for the same content, eliminating the need for a predefined style inventory and outperforming inventory‑based approaches. whyItMatters":"The study provides practical techniques for author‑style transfer in scientific writing, revealing a trade‑off between style fidelity and fluency and demonstrating that hypernetworks can effectively balance these aspects."

By Leonard Popp, Danni Liu, Supriti Sinhamahapatra, Jan Niehues
arXiv Machine Learning
Oct 23

Measuring, Localizing, and Reducing the AI-Like Writing Style of Post-Trained LLMs

The paper investigates how post‑training of language models introduces or amplifies an AI‑like writing style and whether this style has a localized internal signature. By comparing human text, base‑model outputs, and aligned‑model outputs with matched human‑source prefixes, the authors find that aligned generations are less similar to human corpora and more easily detected as AI‑like. They propose PASTA, a training‑free method that estimates a post‑training alignment signature from residual contrasts and ablates the corresponding direction during decoding, reducing detection rates across multiple models and detectors while preserving relevance and coherence.

By Aniket Anand, Janvijay Singh, Zhewei Sun, Dilek Hakkani-T\"ur, Nick Feamster
arXiv AI
Sep 7

Can Activation Steering Capture Multidimensional Authorship Style?

The paper investigates whether activation steering can capture the complex, multidimensional nature of authorship style. By using structured contrastive prompting along rhetorically motivated dimensions, the authors construct rich style representations directly in activation space, revealing a shared authorship backbone with aspect‑specific residuals. They propose Aspect‑Aware Activation Steering (A3S), a training‑free framework that merges per‑aspect contrastive directions, employs interference‑aware aggregation, and tunes steering strength per instance, achieving better authorship style transfer and outperforming a trained baseline on out‑of‑domain benchmarks.

By Hieu Tran, Calvin Bao, Marine Carpuat
arXiv Computation and Language
4d ago

Consistent yet Contextual: Learning Author-Level Mixtures of Style for Authorship Attribution

The paper introduces a new authorship attribution model that represents each author with multiple consistent but distinct writing styles, rather than a single style profile. Experiments across four scenarios—audience size, temporal distance, preceding context, and genre norms—show that authors vary significantly in how idiolectic their writing is, and that certain settings yield text that is more informative about authorship. The authors demonstrate that modeling multiple styles per author leads to significant performance improvements over traditional single-style approaches.

By Omkar Yadav, Michael Jiang, Kenan Alkiek, Jian Zhu, David Jurgens
arXiv AI
Aug 20

Self- and Other-Labels Induce Bidirectional Bias in LLM Judges

The study investigates bias in large language model (LLM) judges by having ten LLMs evaluate narrative constraint selections rather than generated text. Results show that self-preference largely disappears under blind evaluation when quality and evaluator severity are controlled, but self- and other-labels alone shift scores bidirectionally when quality is matched. The authors conclude that authorship attribution drives evaluation bias and that open-ended, ground‑truth‑free tasks can effectively study LLM judge behavior.

By Songeun Chae, Min Kim, Donghoon Jung, Seojin Choi, Seohyon Jung