arXiv AI

SENSESHIFT: Continuous Sentiment-Controlled Text Generation via Encoder-based Mask Infilling

SenseShift is an encoder-based framework that enables fine‑grained, sentence‑level sentiment control in text generation. It uses bidirectional attention, quantized sentiment signals, and iterative mask infilling to generate local sentences conditioned on target sentiment intensity. Experiments on story and review generation show that SenseShift delivers stronger sentiment controllability while preserving text quality and robustness to out‑of‑domain inputs compared to larger decoder‑based baselines.

arXiv Computation and Language
Aug 27

KESA: A Knowledge Enhanced Approach For Sentiment Analysis

The paper introduces KESA, a knowledge‑enhanced approach for sentence‑level sentiment analysis that incorporates sentiment knowledge through two auxiliary tasks: sentiment word cloze and conditional sentiment prediction. These tasks use prior sentiment polarity to guide the selection of sentiment words and the prediction of overall sentiment, respectively, and explore label combination methods to unify multiple label types. Experiments show that KESA consistently outperforms pre‑trained models and complements existing knowledge‑enhanced post‑training methods.

By Qinghua Zhao, Shuai Ma, Shuo Ren
arXiv AI
3d ago

CriticGen: Generation-Aware Evaluation as Actionable Feedback

CriticGen introduces a generation‑aware evaluation framework that generates sample‑specific evaluation dimensions and scoring criteria across categories such as subjective, objective, and self‑derived constraints. These dynamic rubrics produce a score, reason, executable refinement suggestion, and a refined answer, enabling models to diagnose and target flaws in their responses. Experiments show significant gains in rubric quality, score correlation, and actionable feedback, with 73.17% of answers improved and a 93.28% non‑degradation rate.

By Huifang Du, Zecheng Zuo, Sen Wang, Chenghao Fan, Haofen Wang, Yehui Yang
arXiv Computation and Language
Aug 25

Syntax-Guided Diffusion Language Models with User-Integrated Personalization

The paper introduces a syntax-guided diffusion language model that incorporates structural supervision and personalized conditioning to improve text quality, diversity, and controllability. It presents a cascaded framework generating syntactic guidance before text generation, and a novel noncascaded architecture for better structure-content alignment. A shared representation mechanism enables fine‑grained personalization across users, achieving faithful stylistic generation and zero‑shot inference, with experiments showing superior fluency, diversity, and stylistic fidelity.

By Ruqian Zhang, Yijiao Zhang, Juan Shen, Zhongyi Zhu, Annie Qu
Hugging Face Trending Papers
Jul 20

Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shift

We propose Token-Level Off-Policy Labeling (TOPL), an off-policy training paradigm that reframes post-training as a token-level correctness prediction task. Our key intuition is that by training the model to distinguish good and bad tokens in a response, we naturally guide the model towards generating good tokens, while avoiding the pitfalls that come with directly training the model to generate off-policy tokens.