arXiv AI By Paul Trust

Beyond Keywords: Leveraging Generative LLMs and Label Aggregation to Classify Economic Policy Uncertainty in News Articles

Read the original on arXiv AI →

The paper presents a method that uses generative large language models (LLMs) to automatically classify news articles as discussing Economic Policy Uncertainty (EPU) and to identify the specific type of EPU. Unlike earlier keyword‑based or heavily supervised machine learning approaches, this work employs weak supervision by prompting LLMs to generate synthetic labels, making the process cost‑effective and scalable. It also introduces techniques for multi‑label and hierarchical classification of EPU‑related articles.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Aug 24

MIL-BERT: Classification of Arbitrarily Large Text with Performance and Explanatory Guarantees

MIL-BERT is a neural network algorithm that classifies large texts by selecting relevant excerpts, inspired by multiple instance learning. It scales to samples with nearly 1 million tokens and has been evaluated on seven datasets, achieving state‑of‑the‑art results on three long‑text tasks such as political bias detection, trigger warning identification, and author demographic inference. The model also generalizes from weakly‑labeled text bags to accurately classify smaller instances.

By John Cadigan, Dayne Freitag, Eric Yeh
Hugging Face Trending Papers
Sep 2

Dutch Books for Language Models

The paper investigates the coherence of probabilistic forecasts produced by language models, particularly when users rely on them for life decisions involving uncertain events. Using a de Finetti-based method, the authors extract forecasts from language models about stock‑return events and compute the maximum Dutch‑book profit via linear programming, a metric of incoherence that does not require observed outcomes. The study finds significant incoherence, especially when events have complex logical relationships or when irrelevant context is present, and suggests that alternative training strategies could improve probabilistic coherence.

arXiv AI
Sep 3

Dutch Books for Language Models

The paper investigates the coherence of probabilistic forecasts produced by language models, particularly in the context of life‑decision support. Using a de Finetti‑based method, the authors elicit forecasts for events derived from stock return data and compute the maximum Dutch‑book profit via linear programming, which quantifies incoherence. They find significant incoherence, especially when events have complex logical relationships or when irrelevant context is present, and suggest that alternative training strategies could improve coherence.

By Isaiah Andrews, Suproteem Sarkar
arXiv AI
Sep 24

Count Evidence, Not Sentences: Tempered Evidence Fusion of LLM Judgments for Long-Text Value Measurement

arXiv:2609.27165v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to measure public value orientations from long social media posts, yet such posts often mix backgr...

By Yuhe Wu, Rui Qian, Guangyu Wang, Yuran Chen, Yuanchao Zhu, Junjie Yang, Zhengheng Li, Jiulin Cai, Tianyi Zhang, Zihan Dong, Jiaxin Liu, Yujie Chen, Guang Zhang