arXiv AI By Effrosyni Sokli, Isaac Roberts, Alexander Schulz, Barbara Hammer, Gabriella Pasi

ExpertLens: Visualizing Embedding Spaces for Post-Hoc Explainability in MoE Enhanced Retrievers

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Computation and Language
Sep 7

PROMPT2BOX:Improving LLM Weakness Discovery and Specificity Estimation by Uncovering Entailment Structure among Prompts

The paper introduces Prompt2Box, a method that embeds prompts into a box embedding space to capture both semantic similarity and specificity relations, addressing the limitation of traditional vector embeddings that conflate topical similarity with specificity. Using a trained encoder on existing and synthesized datasets, Prompt2Box achieves significant improvements, reducing specificity prediction error by 45% over a prompt-length baseline and identifying 13.5% more LLM weaknesses in hierarchical clustering compared to vector baselines. The authors also present a novel dimension‑reduction technique for visualizing and comparing box embeddings, and provide the code on GitHub.

By Neeladri Bhuiya, Shib Sankar Dasgupta, Andrew McCallum, Haw-Shiuan Chang