arXiv Machine Learning

The Proxy Presumption: From Semantic Embeddings to Valid Social Measures

arXiv:2605. 07409v2 Announce Type: replace-cross Abstract: Natural Language Processing is rapidly evolving into a primary instrument for Computational Social Science, with researchers increasingly using embeddings to measure latent constructs such as novelty, creativity, and bias.

arXiv AI
Aug 11

Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generation

arXiv:2510. 21891v2 Announce Type: replace-cross Abstract: To deploy large language models (LLMs) in high-stakes application domains that require substantively accurate responses to open-ended prompts, we need reliable, computationally inexpensive methods that assess the trustworthiness of long-form responses generated by LLMs.

By Dhrupad Bhardwaj, Julia Kempe, Tim G. J. Rudner
arXiv Machine Learning
Aug 4

Capability Provenance in Language Models: A Case Study in Social Reasoning

arXiv:2606. 19625v2 Announce Type: replace-cross Abstract: We use training-data attribution as an interpretable tool for capability discovery, mapping which regions of the pretraining corpus support social-reasoning versus STEM-reasoning in OLMo3-7B.

By Glenn Matlin, Chandreyi Chakraborty, Saehee Eom, Mika Okamoto, Rayan Castilla, Louis Jaburi, Alvin Deng, Taywon Min, Lucia Quirke, Stella Biderman, Mark Riedl
arXiv Machine Learning
Sep 11

MUtE: A Dual Framework for Concept Erasure and Counterfactual Interventions

The paper introduces MUtE, a dual framework that simultaneously erases concept-specific information from representations and generates counterfactual mappings. By deriving new erasure functions based on optimal bounds, MUtE imposes a translational bias on counterfactual trajectories, aligning with geometric properties of concepts in language models. The authors demonstrate that this approach improves downstream algorithmic fairness and enables the generation of counterfactual texts.

By Antoine Saillenfest
arXiv AI
Jul 14

KGCQual: An Interpretable Framework for Evaluating the Knowledge Graph Construction Quality from Text

arXiv:2607. 10212v1 Announce Type: new Abstract: Knowledge Graphs (KGs) are increasingly constructed through automated extraction pipelines; however, such systems often introduce spurious or incomplete triples, which degrade downstream performance.

By Nipun Misra, Vikranth Udandarao, Aanchal Gupta, Yogender Kumar, Manuj Mukherjee, Raghava Mutharaju
Hugging Face Trending Papers
Sep 2

C$^{3}$T: Counterfactual Causal Reasoning for Sentiment Shifts in Social-Media Conversation Trees

The paper introduces C$^{3}$T, a Counterfactual Causal Conversation Transformer that models sentiment shifts in social‑media conversation trees by treating discourse moves such as denial, evidence, and toxicity as interventions. It adds a causal sentiment reasoning layer, CaSiRe, to public rumor datasets, providing sentiment, shift, intervention, and causal‑source annotations. Experiments show that C$^{3}$T outperforms text‑only, graph‑based, and temporal baselines in predicting sentiment and attribution, revealing that denials and evidence reduce negativity while toxicity increases it.

Hugging Face Trending Papers
Jul 11

KGCQual: An Interpretable Framework for Evaluating the Knowledge Graph Construction Quality from Text

Knowledge Graphs (KGs) are increasingly constructed through automated extraction pipelines; however, such systems often introduce spurious or incomplete triples, which degrade downstream performance. Existing evaluation practices rely heavily on task-specific metrics or small-scale manual verification, offering limited insight into the structural and semantic fidelity of extracted graphs.