arXiv AI
Beyond Black Boxes: Visual Grounding for Text Embeddings
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Oct 13
Beyond Black Boxes: Visual Grounding for Text Embeddings
The paper proposes a sketch-based visual grounding framework that converts text embeddings into topographic sketches to enhance visualization, explainability, and information retrieval. It evaluates the method on the MS-COCO dataset, finding that while SBERT outperforms the sketch-based approach in top‑1 retrieval, the two methods achieve comparable top‑5 results, and a cascaded combination improves performance further. The study suggests that sketch-based representations could be valuable for retrieval tasks if trained directly on text.
arXiv AI
Jun 17
SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches
arXiv:2606. 17646v1 Announce Type: cross Abstract: Saliency map visualizations explain image-based AI predictions by pointing to regions, but these are often unintuitive and semantically unclear, leaving an interpretability gap.
arXiv AI
Jun 24
IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation
arXiv:2606. 24849v1 Announce Type: cross Abstract: Unified multi-modal large language models (MLLMs) have achieved strong text-to-image generation quality, but still struggle with structure-aware prompt following, where object counts, spatial relations, attribute bindings, and coarse layouts must be preserved.
Hugging Face Trending Papers
Jun 23
IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation
Unified multi-modal large language models (MLLMs) have achieved strong text-to-image generation quality, but still struggle with structure-aware prompt following, where object counts, spatial relations, attribute bindings, and coarse layouts must be preserved. We attribute this limitation in part to the entanglement of structural planning and appearance rendering within a single conditioning stream.
Hugging Face Trending Papers
Aug 16
ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval
Visual document retrieval is a critical component of multimodal retrieval-augmented generation, aiming to identify query-relevant pages from document collections where evidence is distributed across t...
arXiv AI
Sep 1
SketchVLM: Vision language models can annotate images to explain thoughts and guide users
arXiv:2604.22875v3 Announce Type: replace-cross Abstract: When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-languag...