Hugging Face Trending Papers

Linguistic Features for Interpretable Textual Entailment

arXiv Computation and Language
Oct 19

Inductive Learning of Concept Embeddings from Cross-Linguistic Colexification Patterns with Textual Attributes

The paper introduces an inductive method for learning concept embeddings from cross‑linguistic colexification networks combined with short textual descriptions. Unlike previous transductive approaches, this framework can embed unseen concepts using only a brief definition. The resulting embeddings correlate with cross‑linguistic similarity measures and generalize well to new concepts.

By Arne Rubehn
arXiv Machine Learning
Oct 3

Beyond Linear Concepts: Discovering and Aligning Non-Linear Concept Manifolds in Large Language Models

The paper extends mechanistic interpretability of large language models by modeling concepts as low‑dimensional non‑linear manifolds rather than linear subspaces. It introduces a concept‑based alignment (CBA) score to compare these manifolds across layers and models, revealing block structures in intermediate layers, a shift from syntax‑dominated to mixed syntactic‑semantic concepts, and training‑dependent multilingual sharing. The study also shows that alignment patterns differ across model families and training stages, with adjacent stages aligning more closely than distant ones.

By Tido Specht, Elias Benedict Krey, Nils Neukirch, Nils Strodthoff
arXiv AI
Oct 2

A Comparative Explainability Framework for DeBERTa-v3 in Zero-Shot Medical Abstract Classification

The paper introduces a comparative explainability framework for auditing DeBERTa‑v3 in zero‑shot medical abstract classification. It evaluates five explanation methods—SHAP, LIME, occlusion, Input × Gradient, and Attention × Gradient—using a natural language inference engine on a balanced corpus of 1,000 abstracts per diagnostic category. The study finds that explanatory stability aligns with predictive certainty, identifies three systemic failure mechanisms, and recommends combining multiple explanation methods and quantitative agreement metrics for transformer‑based medical text classifiers.

By Javier Diaz Esteban-Herreros, David Mu\~noz-Valero, Raquel Mart\'inez-Espa\~na, Jose M. Juarez, Juan Moreno-Garcia
arXiv Computation and Language
3d ago

Text Corpora as Concept Fields: Providing Explainable Groundedness

The paper introduces the Concept Field, a local drift field with pointwise uncertainty derived from sentence-embedding deltas in a text corpus. It scores candidate sentence transitions using the mean absolute z-distance (ζ) to quantify groundedness, offering a model‑agnostic, corpus‑attributable metric. The authors implement a Vector Sequence Database to store embeddings and delta metadata, and demonstrate the method’s effectiveness in detecting groundedness in the U.S. Code of Federal Regulations and novelty in Project Gutenberg, achieving strong selective classification performance under a triage policy.

By Nicholas S. Kersting, Vittorio Castelli, Chieh Ting Yeh, Xinzhu Wang, Saad Taame, Khaoula Allak