arXiv AI By Zhengfeng Zheng, Minghong Fang

Beyond the Prompt: Recovering Hidden Concepts in Text-to-Image Models

Read the original on arXiv AI →

The paper introduces EmbGA, an embedding‑space genetic algorithm designed to uncover hidden concepts in text‑to‑image models that are not explicitly mentioned in prompts. Unlike existing prompt optimizers, EmbGA operates directly in token embedding space, using crossover and mutation to generate valid token sequences that align with unseen visual concepts. Experiments on two benchmarks show that EmbGA outperforms six other optimizers in alignment and token grounding, especially with larger exploration budgets, while also being faster than language‑model‑guided search.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
3d ago

T-DIG: Text-Conditioned Diversity for Image Generation

T-DIG is a text-conditioned diversity framework that enables users to generate multiple images from a single prompt and then request variations along specific axes—such as background, style, or clothing—using natural language. The system employs an LLM policy to produce K axis-conditioned prompts or edit instructions for a frozen image generator or editor, trained with GRPO and a diversity reward. T‑DIG works with open‑weight, distilled, and proprietary models, and the authors release a new dataset of human‑written axes and real user interactions to benchmark text‑conditioned diversity.

By Simran Khanuja, Rohit Gandikota, Gaurav Parmar, Graham Neubig
arXiv Computation and Language
Aug 28

Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models

Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models introduces the VIG‑Sampler, a method that prioritizes tokens for decoding based on their attention to image tokens and penalizes redundancy in image‑attention distributions. The approach aims to improve the quality of multimodal generation by selecting more informative tokens during diffusion decoding. Experiments on seven captioning and VQA benchmarks with three open‑source dMLLMs show that VIG‑Sampler outperforms the Info‑Gain Sampler by an average of 19.3 CIDEr points and achieves better COCO Caption results using only half as many decoding steps.

By Insu Lee, Wooje Park, Wonseok Shin, Jinwoo Son, Byonghyo Shim
arXiv Computer Vision
Sep 3

Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Sampling

The paper investigates how long, richly detailed prompts cause modern text-to-image models to lose diversity, even when many visual aspects are unspecified. It introduces PromptMoG, a training‑free method that samples prompt embeddings from a Mixture‑of‑Gaussians distribution to restore diversity while preserving semantic fidelity. The authors also present LPD‑Bench, a benchmark for evaluating fidelity and diversity under long, semantically dense prompts, and demonstrate PromptMoG’s effectiveness on four large diffusion models.

By Bo-Kai Ruan, Teng-Fang Hsiao, Ling Lo, Yi-Lun Wu, Hong-Han Shuai