arXiv AI
DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
Sep 4
Editable Visual Design
Editable Visual Design introduces a new design paradigm that combines a Coding Agent with a Vision‑Language Model (VLM) and an image generation model. The VLM acts as the creative brain, understanding requirements, planning tasks, and judging aesthetics, while the image generator produces isolated visual assets on demand. The agent follows an "imagine first, then act" workflow, generating assets, writing native HTML/CSS, and refining the design through visual feedback, ultimately producing editable, layer‑wise artifacts with real text that can be adjusted via a graphical interface.
arXiv Computer Vision
Sep 11
Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates
The paper introduces InterIL, a joint generative model that simultaneously produces a background image and a layout of foreground elements for graphic design templates, addressing the limitations of sequential generation approaches. InterIL connects pretrained image and layout diffusion backbones via a learnable communication module, freezing the backbones to preserve prior knowledge while training only the interaction module. The model also offers a test‑time guidance strategy, enabling users to impose preferences without retraining, and demonstrates superior image, layout, and harmonization quality compared to previous methods.
arXiv AI
Jul 28
Design Theater: A Benchmark for Generative UI
arXiv:2607. 22928v1 Announce Type: new Abstract: Generative UI tools promise to democratize UI design by turning natural language descriptions into complete interfaces.
arXiv Machine Learning
Aug 14
From Visual Widgets to UI Code: Efficient Tool-Grounded Generation
arXiv:2608. 12611v1 Announce Type: cross Abstract: Existing screenshot-to-code systems face a trade-off between flexibility and controllability.
arXiv Computer Vision
Oct 28
Abstraction in Style: Beyond Texture and Color
The paper introduces Abstraction in Style (AiS), a generative framework that separates structural abstraction from visual stylization. AiS first creates an abstraction proxy that reinterprets a target image’s structure according to the abstraction logic of a given style, then renders this proxy to produce a stylized output. By learning transformations from visual exemplars without explicit geometric supervision, AiS enables a broader range of stylistic transformations, improves controllability, and allows more expressive stylization.
arXiv Computation and Language
Oct 21
WAFFLE: Finetuning Multi-Modal Models for Automated Front-End Development
arXiv:2410.18362v4 Announce Type: replace-cross Abstract: Web development involves turning UI designs into functional webpages, which can be difficult for both beginners and experienced developers du...