arXiv Machine Learning July 10, 2026 By Baishi Li, Ta Yu, Kelvin J. L. Koa, Ke-Wei Huang

The Proxy Presumption: From Semantic Embeddings to Valid Social Measures

Read the original on arXiv Machine Learning →

arXiv:2605. 07409v2 Announce Type: replace-cross Abstract: Natural Language Processing is rapidly evolving into a primary instrument for Computational Social Science, with researchers increasingly using embeddings to measure latent constructs such as novelty, creativity, and bias.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 11

Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generation

arXiv:2510. 21891v2 Announce Type: replace-cross Abstract: To deploy large language models (LLMs) in high-stakes application domains that require substantively accurate responses to open-ended prompts, we need reliable, computationally inexpensive methods that assess the trustworthiness of long-form responses generated by LLMs.

By Dhrupad Bhardwaj, Julia Kempe, Tim G. J. Rudner

llms rag fine-tuning

arXiv AI

Aug 10

Calibrating WEAT Against Anisotropy: ZCA Whitening as a Geometric Pre-Processing Step for Embedding Association Tests

arXiv:2608. 06908v1 Announce Type: cross Abstract: We propose Zero-phase Component Analysis (ZCA) whitening as a geometric pre-processing step for the Word Embedding Association Test (WEAT).

By Seitaro Ono, Senna Ross, Jun Saiki

llms rag nlp benchmarks safety

arXiv AI

Jun 3

Conditional Hypothesis Generation for LLM-Based Text Analysis with Researcher-Specified Covariates

arXiv:2606. 03029v1 Announce Type: cross Abstract: A core goal of computational social science is to discover interpretable differences in how language varies across outcomes of interest, such as political affiliation or instructional quality.

By Paiheng Xu, Jing Liu, Wei Ai

llms

arXiv AI

Jun 8

DEFINED: A Data-Efficient Computational Framework for Fine-Grained Creativity Assessment in Debate Scenarios

arXiv:2606. 07226v1 Announce Type: cross Abstract: Human creativity has emerged as a critical competency in the era of large language models.

By Tongzhou Yu, Mingjia Li, Hong Qian, Wenkai Wang, Zongbao Zhang, Yaoyu Jiang, Xiangfeng Wang, Aimin Zhou, Jiajun Guo

llms benchmarks safety

arXiv Machine Learning

Jun 5

LLM Explainability with Counterfactual Chains and Causal Graphs

arXiv:2606. 05972v1 Announce Type: new Abstract: Causal graphs provide a high-level language for making mechanisms transparent.

By Nirit Nussbaum-Hoffer, Nitay Calderon, Liat Ein-Dor, Roi Reichart

llms nlp

arXiv AI

Jul 8

RPAM: A Principled Metric for Evaluating Associations in Language Models with High Predictive Validity in Downstream Outputs

arXiv:2607. 05679v1 Announce Type: cross Abstract: Language models (LMs) exhibit problematic biases, such as stereotypes.

By Damian Hodel, Jevin West, Aylin Caliskan

llms rag benchmarks

Related stories

Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generation

Calibrating WEAT Against Anisotropy: ZCA Whitening as a Geometric Pre-Processing Step for Embedding Association Tests

Conditional Hypothesis Generation for LLM-Based Text Analysis with Researcher-Specified Covariates

DEFINED: A Data-Efficient Computational Framework for Fine-Grained Creativity Assessment in Debate Scenarios

LLM Explainability with Counterfactual Chains and Causal Graphs

RPAM: A Principled Metric for Evaluating Associations in Language Models with High Predictive Validity in Downstream Outputs