arXiv Computation and Language

Preference Optimization Improves Definition Generation: Semantic Change in EU Institutional Sustainable Finance Disclosures

arXiv Computation and Language
Aug 21

SynFlow: A Multidimensional Diachronic Semantic Analysis Toolkit

arXiv:2608. 19472v1 Announce Type: new Abstract: Lexical semantic change (LSC) is commonly modelled through vector-space representations, but these approaches often provide limited insight into which aspects of usage are changing.

By Bach Phan-Tat, Kris Heylen, Dirk Geeraerts, Stefano De Pascale, Dirk Speelman
arXiv Computation and Language
Sep 28

Towards Automated Lexicography: Generating and Evaluating Definitions for Learner's Dictionaries

The paper tackles the problem of automatically generating dictionary definitions for learner’s dictionaries, focusing on simplicity and clarity. It introduces a new evaluation framework that uses large language models as judges, validated against human annotators with comparable agreement levels. The authors also present an iterative simplification approach that produces definitions scoring highly on their criteria and exhibiting lexical simplicity.

By Yusuke Ide, Adam Nohejl, Joshua Tanner, Hitomi Yanaka, Christopher Lindsay, Taro Watanabe
arXiv Computation and Language
Sep 22

The BD-LSC Dataset: Facilitating the Benchmarking of Models for Lexical Semantic Change Detection in Slang and Standard Usage

The BD-LSC dataset introduces a bi‑directional lexical semantic change benchmark that tracks sense gain, loss, and stability across three time periods, while the ST‑WSD dataset offers fine‑grained, instance‑level sense annotations for words that blend slang and standard usage. These resources enable systematic evaluation of diverse models—including unsupervised clustering, supervised learning, transformer‑based approaches, and large language models—on tasks such as exact sense matching and multi‑label accuracy. The evaluation shows that few‑shot GPT‑4o performs best overall, yet all systems struggle with rare slang senses, highlighting a key open challenge in the field.

By Afnan Aloraini, Riza Batista-Navarro
arXiv Computation and Language
Sep 3

What Transfers Under Source Shift? Definitions, Examples, and Fine-Tuning for Climate Disclosure Classification

The paper investigates how climate disclosure classification performs when the source of the text changes, such as moving from annual reports to press releases or earnings calls. It evaluates three adaptation strategies—definitions, examples, and fine‑tuning—across eleven large language models using two corpora that share the same label space but differ in source. The study finds that while all strategies improve cross‑source performance on average, the most effective in‑source methods (similarity‑based retrieval and LoRA fine‑tuning) lose much of their advantage when the source shifts, whereas simpler approaches like randomly selected few‑shot examples and definition‑based prompts remain more robust, especially when definitions match the granularity of the target text.

By Guosheng Li, Fenghui Ren, Bin Liu, Chuan Yu, Kaiying Ji, Lin Yue, Jun Shen, Sasa Qian
arXiv AI
Jun 29

POTracker: Optimizing Large Language Models for Standard-Compliant Power Outage Report Generation

arXiv:2606. 23533v2 Announce Type: replace Abstract: Recent large language models (LLMs) are good at general text generation, but it is still hard to use them for domain-specific data generation because the output must follow strict formatting and structural rules.

By Hung Phan, Aniroop Naladala, Dubey Avanindra, Supryia Chinthavali, Lunga Dalton, Ali Jannesari
arXiv Computation and Language
Sep 17

Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?

The study investigates whether contextual embeddings can detect meaning changes in scientific terminology beyond traditional frequency counts. Using Astrophysics and NLP corpora from 2010 to 2024, the authors extract candidate terms with KeyBERT, filter for significant frequency rises, and then evaluate semantic drift via multiple embedding‑based metrics. Results show that frequency methods slightly outperform embedding metrics in aligning with expert judgments, yet embedding‑only detections (e.g., "primordial black holes") reveal critical conceptual shifts missed by frequency alone, suggesting complementary value.

By Jianying Liu (STL, BETA, CEIPI), Kim Gerdes (LISN, Qatent, STL), Jean-Marc Deltorn (CEIPI)
arXiv Computation and Language
3d ago

How Green Is Your Manifesto? Scoring Environmental Positions in the 2024 EU Elections with an LLM Panel

The study introduces a panel of three large language models that score each sentence of political manifestos on environmental protection and climate change, producing averaged manifesto-level ratings. Applied to 41 2024 European Parliament election manifestos, the model’s rankings align closely with the Chapel Hill Expert Survey but tend to rate parties as greener than experts, suggesting a gap between promises and practice. The approach offers a low‑cost, multilingual, and reproducible alternative to traditional expert surveys and hand‑coding, with inter‑model disagreement serving as a built‑in reliability check.

By Franco Corti, Sajid Siraj
arXiv Machine Learning
Aug 20

Converting Expert Deliberation into Financial Signals Through A Context-Aware NLP Pipeline

The paper presents the CDSP (context-conditional deliberation signal pipeline), which transforms investment committee meeting transcripts into structured predictive features. CDSP segments transcripts into topical chunks, assigns asset‑class context labels via a large language model, maps financial keywords to a taxonomy, and adds sentiment polarity and mention frequency features. Using these engineered features on 48 monthly meetings, the best model—combining sentence embeddings with CDSP features—achieves 73% accuracy and a 0.73 F1 score, outperforming a simple stock‑choice baseline, though the improvement is not statistically significant.

By Vivek Batra, Kristin Chen, Sanjiv Das, Samuel Judge, Harshad Khadilkar, Sukrit Mittal, Amir Nasrollahzadeh, Daniel Ostrov, Jacob Sisk