arXiv Computation and Language

Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs

The paper evaluates Jev, a specialized decision model, on stance detection tasks using the VAST (English) and ZS-CSD (Chinese) datasets. Jev matches GPT‑5.6 and outperforms other general‑purpose LLMs on VAST, but lags behind stronger LLMs on ZS‑CSD, especially in distinguishing favor from against. The authors suggest that Jev’s limitations may stem from difficulties in understanding reply relationships and stance direction rather than conversation length.

arXiv AI
Jul 28

StanceBench: A Benchmark for Audio LLM-Based Interpersonal Stance Evaluation from Speech

arXiv:2607. 22658v1 Announce Type: new Abstract: Speech-to-speech dialogue models increasingly depend on prosody and interactional nuance to convey social intent, yet benchmarks for these cues remain limited.

By Yuzhe Wang (Electrical and Computer Engineering Department, Johns Hopkins University, Baltimore, USA), Thomas Thebaud (Electrical and Computer Engineering Department, Johns Hopkins University, Baltimore, USA), Jennifer Hu (Department of Cognitive Science, Johns Hopkins University, Baltimore, USA), Jes\'us Villalba-Lopez (Electrical and Computer Engineering Department, Johns Hopkins University, Baltimore, USA), Venkatesh Ravichandran (Amazon AGI, USA), Georgi Tinchev (Amazon Research, UK), Najim Dehak (Electrical and Computer Engineering Department, Johns Hopkins University, Baltimore, USA), Laureano Moro-Vel\'azquez (Electrical and Computer Engineering Department, Johns Hopkins University, Baltimore, USA)
arXiv Computation and Language
Oct 5

StanceEval 2026: The Second Stance Detection Shared Task

StanceEval 2026 is the second edition of a shared task on stance detection in Arabic social media, where systems must classify a tweet’s stance toward a target as Favor, Against, or None. The event featured two tracks: Track 1 tests cross‑target transfer on thematically related topics (Women Driving vs. Women Empowerment), while Track 2 evaluates cross‑domain transfer to entirely unseen targets (E‑Cars and Trimester System). With 80 registered teams and 30 submissions, top systems achieved $F_{avg2}$ scores of 0.8994 (Track 1) and 0.9400 (Track 2), surpassing baseline performance and highlighting challenges such as target polarization and dialectal nuance.

By Rasha Albalawi, Nuha Albadi, Hamzah Luqman, Asma Yamani, Maram Kurdi, Saad Ezzini, Ahmed Ashraf, Maged Al-Shaibani, Nora Alturayeif
arXiv Computation and Language
Oct 12

MoPrO-SD: Modular Prompt Optimization for Stance Detection

MoPrO‑SD is a stance‑specific prompt optimization framework that breaks prompts into semantic modules and refines them sequentially with LLM feedback. It evaluates three refinement strategies—instruction‑only, instruction with reasoning, and instruction with per‑example reasoning—using class‑conditioned errors to improve stance detection. The authors also release VaccineStance, a new human‑annotated benchmark for vaccine stance detection, and demonstrate that MoPrO‑SD outperforms human‑written base prompts across multiple datasets and open‑weight LLMs.

By Meysam Sabbaghan, Nikesh Gyawali, Arman Zareian Jahromi, Sebastian Loera-Lozano, Doina Caragea, Cornelia Caragea
arXiv Computation and Language
Oct 5

Mawqif-XT: An Arabic Benchmark Dataset for Cross-Target Stance Detection

The paper introduces Mawqif-XT, a new Arabic benchmark dataset comprising 996 manually annotated tweets from three public targets: Women Driving, E-Cars, and Trimester System. Each tweet is labeled for stance, sentiment, and sarcasm following the Mawqif annotation scheme, and the dataset is intended as a held‑out evaluation set to test cross‑target generalization. Baseline results are provided using Arabic and multilingual transformer models as well as zero‑shot large language models, enabling reproducible evaluation alongside the original Mawqif dataset.

By Rasha Albalawi, Nuha Albadi, Hamzah Luqman, Maram Kurdi, Saad Ezzini, Asma Yamani, Ahmed Ashraf
arXiv Computation and Language
2d ago

How Different, or Different How? Stance Granularity in Viewpoint Selection for Dialog Systems that Engage Users with Alternative Views

The paper introduces a stance‑granularity selection policy for dialog systems that engage users with alternative viewpoints. By using Perspectivized Stance Vectors to break positions into concept‑level stances, the system selects the most novel viewpoint within a bandit‑controlled distance bound. Experiments with 63 participants show that concept‑level stance yields more varied exposure sequences and broader coverage of topic positions, though it does not affect depth of justification or reconstruction accuracy.

By Morita Tarvirdians, Reeve Lorena, Catharine Oertel
arXiv Computation and Language
Oct 16

Mind the Shift: Decoding Monetary Policy Stance from FOMC Statements with Large Language Models

The paper introduces Delta-Consistent Scoring (DCS), an annotation‑free method that uses large language model representations to produce continuous monetary‑policy stance scores. DCS jointly learns absolute stance for each FOMC statement and relative shifts between consecutive statements, enforcing consistency through a delta‑consistency objective. The approach outperforms supervised probes and LLM‑as‑judge baselines, achieving up to 71.1% accuracy on sentence‑level hawkish‑dovish classification and producing meeting‑level scores that correlate strongly with inflation indicators and Treasury yield movements.

By Yixuan Tang, Yi Yang
arXiv Computation and Language
Sep 1

MMDS-Bench: Benchmarking Multimodal Large Language Models on Dynamic Stance in Social Media Interactions

MMDS-Bench is a new diagnostic benchmark for multimodal dynamic stance classification in social media parent‑reply interactions. It contains 3,482 multimodal instances annotated with a seven‑label stance taxonomy, plus an 800‑instance subset that demands structured reasoning over parent and reply understanding and stance‑relation inference. The benchmark also tags each instance with five challenge factors—multimodal fusion, parent framing, non‑literal expression, interaction reasoning, and label‑boundary ambiguity—and evaluates 12 multimodal large language models using a reference‑grounded LLM‑judge protocol, revealing that current models still struggle with relational inference beyond separate parent and reply comprehension.

By Yuzhe Ding, Kang He, Li Zheng, Shengwu Zheng, Teng Shi, Fei Li, Chong Teng, Donghong Ji
arXiv Computation and Language
3d ago

To Manipulate or Not: Opinion Dynamics in LLM Interactions

The paper introduces a controlled debate framework where two large language models (LLMs) discuss a contested topic—climate‑change attribution—while one model is assigned a stance and sometimes instructed to persuade. Across experiments with GPT‑6, Luna, and Gemini 2.5 Flash Lite, the authors observe that same‑model interactions tend to narrow opinion gaps for one model, whereas cross‑model interactions widen them. The study finds that explicit stance reports and in‑dialogue behavior capture different aspects of opinion dynamics, and that a blanket persuasion instruction does not reliably increase influence.

By Mohammad Siahkamari, Phuoc Dat Nguyen, Stephen MacNeil