arXiv AI
MONET: A Massive, Open, Non-redundant and Enriched Text-to-image dataset
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
Sep 14
Unified Text-Image Generation with Weakness-Targeted Post-Training
The paper introduces a post‑training approach that enables a single inference process to transition from text reasoning to image synthesis, eliminating the need for explicit modality switching. Using the 14B BAGEL model, the authors demonstrate that targeted post‑training data and reward‑weighted training improve multimodal image generation across four independent T2I benchmarks. The study highlights the benefits of joint text‑image generation and strategic data selection for enhancing T2I performance.
arXiv Computer Vision
Oct 5
DEPICT: Scoring Text-to-Image Alignment by Answer Agreement
DEPICT is a new training‑free metric for evaluating text‑to‑image alignment. It replaces fixed reference answers with an agreement rule that compares image‑based and caption‑only responses, weighting questions by how decisively the caption determines them. By merging this agreement score with a holistic score, DEPICT improves negation accuracy dramatically and outperforms existing training‑free metrics while matching or exceeding fine‑tuned evaluators on several benchmarks.
arXiv AI
Jun 8
TEVI: Text-Conditioned Editing of Visual Representations via Sparse Autoencoders for Improved Vision-Language Alignment
arXiv:2606. 07451v1 Announce Type: cross Abstract: Vision-language models such as CLIP are highly useful for diverse tasks due to their shared image-text embedding space.
arXiv AI
Aug 19
From Corpora to Co-Evolving Capabilities: Capability-Centric Data Design for Generalist Image Generation
The paper introduces a capability‑centric data infrastructure for generalist image generation, integrating task‑specific supervision with a curriculum that aligns with the dependencies among generative capabilities. It employs three interoperable data engines—text‑image grounding, inter‑image transformation, and image‑knowledge association—alongside caption experts to harmonize text‑to‑image and editing supervision. The system curates massive corpora (440M T2I images, 120M editing pairs, 27M image‑entity pairs) and trains multimodal diffusion models (3B and 6B parameters) from scratch, achieving broad visual coverage and versatile rendering as shown by CPI‑Bench and qualitative tests.
arXiv Computer Vision
Sep 2
A Glance Is All You Need: Single-Pass Fine-Grained Image Captioning with SimLoss
arXiv:2609.00591v1 Announce Type: new Abstract: An image may be worth a thousand words, but most captioning models describe it in only a few. Modern vision-language models produce fluent high-level c...
arXiv AI
Jul 3
SEPS: Semantic-enhanced Patch Slimming Framework for fine-grained cross-modal alignment
arXiv:2511. 01390v2 Announce Type: replace-cross Abstract: Fine-grained cross-modal alignment aims to establish precise local correspondences between vision and language, forming a cornerstone for visual question answering and related multimodal applications.