arXiv Machine Learning

Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns

The paper introduces NoLBERT, a language model pretrained only on financial news from 1976 to 1995, and adapts it into a sentence encoder via contrastive fine‑tuning. It compares NoLBERT’s topic extraction to LDA, MiniLM, and FinBERT on 1.26 million articles from 2012 to 2024, converting topics into attention shocks and stock exposures to forecast returns of the 1,000 largest US stocks across multiple models and rebalancing frequencies. While NoLBERT produces the most stable topics and performs comparably to LDA, the best‑validated model still loses money, and an equal‑weight blend of all readers yields a monthly net Sharpe ratio of 1.12, significant against zero but not against a price‑only benchmark.

arXiv Machine Learning
Jun 5

Is attention truly all we need? An empirical study of asset pricing in pretrained RNN sparse and global attention models

arXiv:2508. 19006v2 Announce Type: replace-cross Abstract: This study investigates the pre-trained RNN attention models with the mainstream attention mechanisms, such as additive attention, Luong's three attentions, global self-attention and sliding window sparse attention, for the empirical asset pricing research on the top 420 large-cap US stocks.

By Shanyan Lai
arXiv Machine Learning
Sep 18

Evaluating Financial Sentiment in the Age of AI

The paper evaluates twelve financial sentiment models—including dictionary-based methods, finance-specific transformers, and open-source large language models—using linguistic and economic validity criteria. General-purpose LLMs match finance-specific transformers in classification performance but do not yield stronger economic relationships. While several models correlate with earnings surprises, none shows a significant link to next‑day stock returns, and performance is strongest for large earnings beats or misses.

By Arslan Bisharat, Oudom Hean
arXiv Computation and Language
Sep 28

PALM: Point-in-Time Adaptation for Financial Language Models

arXiv:2609.30316v1 Announce Type: cross Abstract: Language models used in financial backtests suffer from look-ahead bias, as a model trained on text published after the study period has already obse...

By Seunghan Lee, Jun Seo, Jaehoon Lee, Junhyeok Kang, Sangjun Han, Sungdong Yoo, Minjae Kim, Tae Yoon Lim, Dongwan Kang, Hwanil Choi, Soonyoung Lee, Wonbin Ahn
arXiv Machine Learning
Aug 19

Temporal Leakage in Financial News NLP: A Multi-Architecture Audit with a Regime-Specific M&A Signal

The paper audits the impact of temporal leakage on financial-news direction prediction across 49,799 articles and 16 feature-model combinations, including TF‑IDF, MiniLM, FinBERT, and fine‑tuned RoBERTa‑large / DeBERTa‑v3‑large, as well as zero/few‑shot and LoRA probes of Llama‑3 and Qwen2.5. Random train‑test splits inflate MCC scores by 1.1× to 6.5×, with larger models and richer features showing greater gains, while end‑to‑end FinBERT fine‑tuning actually increases the gap. Only the mergers and acquisitions (M&A) category shows a positive locked‑test signal under near‑temporal chronological evaluation, with the signal localized to 2024‑2025 European‑tilted M&A semantics and not transferring to a 2009‑2020 U.S. corpus.

By Chenhao Xue, Raslen Guesmi, Siwei Feng, Yucheng Gong, Jacob Xavier Sundram, Jordan Pang, Lan Wang, Julian Kaljuvee