arXiv:2607. 22676v1 Announce Type: new Abstract: Post-training is a key mechanism for adapting large language models to downstream tasks.
By James Elcock, William F. Shen, Xinchi Qiu, Nicholas D. Lane
arXiv:2510. 26707v2 Announce Type: replace-cross Abstract: As LLMs occupy an increasingly important role in society, they are more and more confronted with questions that require them not only to draw on their general knowledge but also to align with certain human value systems.
By Mehar Bhatia, Shravan Nayak, Gaurav Kamath, Marius Mosbach, Karolina Sta\'nczak, Vered Shwartz, Siva Reddy
arXiv:2606. 09653v1 Announce Type: new Abstract: Learned representations across models and modalities often exhibit striking structural similarities, suggesting shared underlying concept decompositions.
By Gr\'egoire Dhimo\"ila, Victor Boutin, Agustin Martin Picard, Thomas Fel, Thomas Serre
arXiv:2510.01030v2 Announce Type: replace
Abstract: The human ability to translate diverse perceptual and linguistic inputs into structured behavior has been thought to rest on learning robust repres...
By Zach Studdiford, Timothy T. Rogers, Kushin Mukherjee, Siddharth Suresh
VALCON introduces a role-driven framework to benchmark and improve value consistency in large language models (LLMs) by evaluating how well an LLM’s generative outputs align with its evaluative judgments when the same model alternates between generator and evaluator roles. The framework creates three benchmark suites—VAB-Consistency, VAB-Boundary, and VAB-Challenge—using dual-role variation to expose hidden value discrepancies. Experiments across 28 LLMs reveal widespread cross-role inconsistency, and mechanistic probing identifies a role-dependent representational decoupling; a representation-directed intervention is then proposed to mitigate these failures, establishing value consistency as a distinct alignment dimension.
By Junru Wu, Jingting Zheng, Yuqi Ren, Deyi Xiong
The paper investigates how preference tuning—optimizing language models with explicit preference signals—behaves when applied to new domains. It systematically compares five alignment objectives and several adaptation strategies, such as target‑domain supervised fine‑tuning and pseudo‑labeling, across summarization, question‑answering helpfulness, and safety tasks. Results show that while pseudo‑labeling reduces domain‑shift degradation, it also causes mode collapse, highlighting a trade‑off between generalization and diversity.
By Constantinos Karouzos, Xingwei Tan, Nikolaos Aletras