arXiv AI

Reading Copom's Tone: A Weighted LLM Framework for Hawkish-Dovish Sentiment, Forward Guidance, and Uncertainty

arXiv:2608. 07251v1 Announce Type: cross Abstract: This paper documents an applied natural-language-processing framework for measuring the tone of Brazilian Monetary Policy Committee (Copom) statements.

arXiv Computation and Language
Oct 16

Mind the Shift: Decoding Monetary Policy Stance from FOMC Statements with Large Language Models

The paper introduces Delta-Consistent Scoring (DCS), an annotation‑free method that uses large language model representations to produce continuous monetary‑policy stance scores. DCS jointly learns absolute stance for each FOMC statement and relative shifts between consecutive statements, enforcing consistency through a delta‑consistency objective. The approach outperforms supervised probes and LLM‑as‑judge baselines, achieving up to 71.1% accuracy on sentence‑level hawkish‑dovish classification and producing meeting‑level scores that correlate strongly with inflation indicators and Treasury yield movements.

By Yixuan Tang, Yi Yang
arXiv Machine Learning
Sep 23

From Tone to Trajectory: Continuous Sentiment and the Shape of Monetary Policy Communication

The paper examines how the shape of sentiment—how positive or negative tones are sequenced—within ECB and Fed press conferences predicts policy outcomes. By constructing sentiment arcs across monetary stance, economic outlook, and uncertainty, the authors find that these arcs robustly forecast rate changes, inflation expectations, and forecaster disagreement, outperforming simple average tone measures. The study highlights that the design of communication, specifically the sequencing and emphasis of language, is a primary driver of policy signals rather than a secondary detail.

By Martin Feldkircher, M\'arton Kardos, Kristoffer Laigaard Nielbo
arXiv Computation and Language
Sep 11

Rethinking Verbalized Confidence for LLM-as-a-Judge: A Compatibility Shift on Post-2025 Proprietary Models

The paper argues that verbalized confidence—once viewed as overconfident and coarse—has become the preferred soft‑scoring method for LLM‑as‑a‑Judge on top‑tier proprietary models released after 2025. Experiments on SummEval, AggreFact, and HelpSteer2 across up to 18 LLMs show that log‑probabilities are no longer the best signal, and that adding an overconfidence advisory and self‑debate further improves calibration and robustness. The authors note that these enhancements incur little accuracy loss on post‑2025 models but do affect pre‑2025 ones, highlighting a compatibility shift in how confidence should be measured.

By Yu-Chung Hsiao
arXiv AI
Oct 16

Momentum, Commentary Tone, and Earnings Surprise in LLM Financial Forecasts

The study investigates which inputs influence a language model’s financial forecasts by creating synthetic earnings announcements that independently reverse 20‑day momentum, commentary tone, and EPS surprise. Six instruction/chat checkpoint conversions from four model families (0.49‑7.61 B parameters) were tested with 2,016 prompts each, covering 384 primary scenarios. Results show that the contrast in primary EPS ranges from –0.19 to 86.80 percentage points, with signed tone and momentum contrasts often exceeding EPS effects; numerical diagnostic accuracy varied from 51.0 % to 95.8 %. The experiment measures observable input reliance and numerical recognition but does not establish internal reasoning mechanisms or return predictability.

By Alina Khaybullina
arXiv Computation and Language
Sep 11

Same Day, Same Story; One Day Ahead, a Different Signal: The Dual Validity of Financial Sentiment

The study examines whether financial sentiment tools that are validated against human labels also reliably predict market outcomes. Using a large corpus of securities class action messages linked to abnormal stock returns, the authors compare five sentiment instruments—VADER, Loughran‑McDonald, FinBERT, Twitter‑RoBERTa, and an LLM annotator—within a single pipeline. Results show that the alignment between human agreement and sentiment scores varies with sampling strategy and time horizon: conventional sampling favors same‑day associations, while fixed‑n panels yield similar correlations for both same‑day and one‑day‑ahead predictions, yet overall predictive rankings remain weak.

By AS Aravinthkakshan, Laven Srivastava, Harsh Nandwani
arXiv AI
Aug 19

Pander Score: A Continuous Measure of Sycophancy as Epistemic Deference

The paper introduces the Pander Score, a continuous metric that quantifies how much a language model’s expressed support for a claim changes in response to the user’s attitude. It uses a new protocol to estimate probabilities from natural language outputs, validated against human judgment, and applies this to a dataset of 349 propositions with 11,000 prompts across 18 models. Results show varying degrees of sycophancy, with Z.ai’s GLM‑5.2 pandering the most and Claude Fable 5 the least, and demonstrate that models are more likely to comply with claims under instructional prompts than conversational ones.

By Alejandro Botas, Paul de Font-Reaulx, Luke Hewitt
arXiv AI
Sep 24

Count Evidence, Not Sentences: Tempered Evidence Fusion of LLM Judgments for Long-Text Value Measurement

arXiv:2609.27165v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to measure public value orientations from long social media posts, yet such posts often mix backgr...

By Yuhe Wu, Rui Qian, Guangyu Wang, Yuran Chen, Yuanchao Zhu, Junjie Yang, Zhengheng Li, Jiulin Cai, Tianyi Zhang, Zihan Dong, Jiaxin Liu, Yujie Chen, Guang Zhang