arXiv Computation and Language

Text Corpora as Concept Fields: Providing Explainable Groundedness

The paper introduces the Concept Field, a local drift field with pointwise uncertainty derived from sentence-embedding deltas in a text corpus. It scores candidate sentence transitions using the mean absolute z-distance (ζ) to quantify groundedness, offering a model‑agnostic, corpus‑attributable metric. The authors implement a Vector Sequence Database to store embeddings and delta metadata, and demonstrate the method’s effectiveness in detecting groundedness in the U.S. Code of Federal Regulations and novelty in Project Gutenberg, achieving strong selective classification performance under a triage policy.

arXiv AI
Jun 3

Fixing FOLIO and MALLS: Verified Annotations and an LLM-assisted Framework to Focus Human Relabeling

arXiv:2606. 02837v1 Announce Type: cross Abstract: Accurate translation from Natural Language to First-Order Logic (NL-to-FOL) underpins neurosymbolic AI systems and Natural Language Inference (NLI), making the quality of NL-to-FOL benchmarks essential -- yet these datasets have never been rigorously audited.

By Andrea Brunello, Cristian Curaba, Luca Geatti, Michele Mignani, Angelo Montanari, Nicola Saccomanno
arXiv AI
Aug 11

Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generation

arXiv:2510. 21891v2 Announce Type: replace-cross Abstract: To deploy large language models (LLMs) in high-stakes application domains that require substantively accurate responses to open-ended prompts, we need reliable, computationally inexpensive methods that assess the trustworthiness of long-form responses generated by LLMs.

By Dhrupad Bhardwaj, Julia Kempe, Tim G. J. Rudner