arXiv Computer Vision
Aug 25

SketchFlow: Zero-Shot Vector Sketch Generation via GMM Prior Flow in CLIP Latent Space

SketchFlow is a new generative framework for creating high‑quality vector sketches from text prompts. It uses a Gaussian Mixture Model prior in the CLIP latent space and an Optimal Transport Conditional Flow Matching model to map this prior to sketch features, which are then decoded by a Hybrid Diffusion Decoder combining 1D U‑Net and Transformer architectures. The approach achieves superior visual quality and human‑like drawing styles, and supports zero‑shot synthesis for unseen concepts and smooth semantic interpolation.

By Jin Zhou, Hongliang Yang, Pengfei Xu, Hui Huang
Hugging Face Trending Papers
Aug 10

SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision

Despite rapid advances in generative models, achieving pixel-level precision in sketch-based image editing remains a persistent challenge, particularly for fine-grained local deformations. This gap stems primarily from the critical shortage of high-quality, publicly available benchmark datasets that jointly provide geometric constraints and semantic instructions.

arXiv Machine Learning
Aug 13

Draw This First

arXiv:2608. 12064v1 Announce Type: cross Abstract: We invert the typical formulation of sketch generation: instead of drawing strokes in order, we predict a 2D field that defines the order in which strokes are drawn.

By Dazhi Zhong, Rowan Bradbury, Grant Davis
Hugging Face Trending Papers
Jun 23

IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation

Unified multi-modal large language models (MLLMs) have achieved strong text-to-image generation quality, but still struggle with structure-aware prompt following, where object counts, spatial relations, attribute bindings, and coarse layouts must be preserved. We attribute this limitation in part to the entanglement of structural planning and appearance rendering within a single conditioning stream.

arXiv AI
Jun 24

IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation

arXiv:2606. 24849v1 Announce Type: cross Abstract: Unified multi-modal large language models (MLLMs) have achieved strong text-to-image generation quality, but still struggle with structure-aware prompt following, where object counts, spatial relations, attribute bindings, and coarse layouts must be preserved.

By Zixuan Li, Haokun Lin, Yicheng Xiao, Zhiwei Li, Xinyang Song, Zelong Zheng, Yong He, Heng Yao, Ke Ding, Chao Yu, Chuan Yuan, Qi Li, Zhenan Sun
arXiv Computer Vision
Oct 5

ProgressNet: Sketching and Prompting with a Frozen Text-to-Image Model

ProgressNet is a training‑free framework that enables a frozen text‑to‑image model to follow a sketching session in real time. It allows strokes to be added or erased, prompts to be revised, and produces an updated image in about a second per turn without adding new parameters. The method uses three inference‑time mechanisms—Previous‑Concept Memory, Layer‑Selective K/V Injection, and Banded Adaptive Control—to maintain fidelity and coherence across sketch domains, outperforming existing approaches especially when sketches are partially erased.

By Arkaprabha Basu, Chaitat Utintu, Yi-Zhe Song