arXiv AI August 13, 2026 By Nicholas S. Kersting, Vittorio Castelli, Chieh Ting Yeh, Xinzhu Wang, Saad Taame, Khaoula Allak

Text Corpora as Concept Fields: Black-Box Hallucination and Novelty Measurement

Read the original on arXiv AI →

arXiv:2605. 05103v3 Announce Type: replace-cross Abstract: We introduce the \textbf{Concept Field} of a text corpus: a local drift field with pointwise uncertainty, estimated in sentence-embedding space from the deltas between consecutive sentences.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning

Aug 4

LLM generation novelty through the lens of semantic similarity

arXiv:2510. 27313v3 Announce Type: replace Abstract: Generation novelty is a key indicator of an LLM's ability to generalize, yet measuring it against full pretraining corpora is computationally challenging.

By Philipp Davydov, Ameya Prabhu, Matthias Bethge, Elisa Nguyen, Seong Joon Oh

llms rag fine-tuning safety

arXiv Machine Learning

Jun 2

When Hard Negatives Hurt: Bridging the Generative-Discriminative Gap in Hard Negative Synthesis for Retrieval

arXiv:2606. 01304v1 Announce Type: new Abstract: Hard negative mining has become the dominant strategy for training retrievers, yet it faces intrinsic limitations: negatives are bounded by corpus availability, selected by retriever score rather than diagnostic value, and increasingly contaminated by false positives as the retriever improves.

By Zhicheng Zhang, Jiwei Tang, Kuicai Dong, Xiaopeng Li, Jieming Zhu, Jingyu Li, Qianhui Zhu, Fengyuan Lu, Wang Jiaheng, Gang Wang, Hai-Tao Zheng, Zhaocheng Du

llms

arXiv AI

Jul 7

Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)

arXiv:2607. 04223v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) reduces but does not eliminate hallucination, and existing detectors return a single answer-level score that does not indicate which sentence is unsupported, or why.

By Mohamed Aly Bouke

rag nlp benchmarks safety

arXiv Computation and Language

Sep 22

Linguistic Features for Interpretable Textual Entailment

arXiv:2609.24932v1 Announce Type: new Abstract: Despite the success of neural models in natural language processing, their black-box nature limits interpretability and conceals the linguistic phenome...

By David Torres-Moreno, Jorge Hermosillo-Valadez, Asela Reig-Alamillo

rag nlp benchmarks safety

arXiv AI

Aug 10

Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes

arXiv:2608. 07208v1 Announce Type: cross Abstract: Existing measures of how much a text is about a concept read the surface of the text: dictionary word shares, topic proportions, embedding similarities.

By Luc Hazenoot, Zhaochun Ren, Amirhossein Zohrehvand

llms rag fine-tuning

arXiv AI

3d ago

Interpretable but Fragile? Robustness of Concept Bottlenecks under Geometric-Semantic Perturbations

arXiv:2609.38625v1 Announce Type: cross Abstract: Concept Bottleneck Models (CBMs) are designed to provide interpretable intermediate representations, yet how such bottlenecks affect robustness remai...

By Hanwei Zhang, Tianma Hu, Gaojie Jin, Xu Cheng, Ronghui Mu

diffusion safety

One email a morning, machine-written

Related stories

LLM generation novelty through the lens of semantic similarity

When Hard Negatives Hurt: Bridging the Generative-Discriminative Gap in Hard Negative Synthesis for Retrieval

Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)

Linguistic Features for Interpretable Textual Entailment

Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes

Interpretable but Fragile? Robustness of Concept Bottlenecks under Geometric-Semantic Perturbations