We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at OpenAI Blog.
We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the “zero-shot” capabilities of GPT-2 and GPT-3.
Extend creativity and tell a bigger story with DALL·E images of any size.
arXiv:2603. 01696v2 Announce Type: replace-cross Abstract: Large Vision-Language Models (LVLMs) often omit or misrepresent critical visual content in generated image captions.
arXiv:2606. 08847v1 Announce Type: cross Abstract: Despite the success of image generation from text descriptions, it still faces challenges that are difficult to overcome in domains such as natural language processing (NLP) and computer vision (CV).
The paper introduces the CO-AID dataset, which captures systematic defects in state‑of‑the‑art text‑to‑image models when prompts involve complex composition such as multiple entities and attributes. Researchers manually curated 651 reference images across people, hand, object, and scene categories, edited ChatGPT‑generated prompts to emphasize compositional factors, and generated AI images with three T2I models. A subjective study with 29 participants produced multi‑label defect annotations, enabling training of a deep model that predicts defects and improves image generation.
Similes provide a compact and expressive way to describe visual characteristics in text prompts. Recent text-to-image models (t2i models) can produce visually compelling outputs from simile prompts, yet even frontier models frequently misinterpret the metaphorical vehicle and confuse it with the object.