arXiv AI
DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
Sep 4
Editable Visual Design
Editable Visual Design introduces a new design paradigm that combines a Coding Agent with a Vision‑Language Model (VLM) and an image generation model. The VLM acts as the creative brain, understanding requirements, planning tasks, and judging aesthetics, while the image generator produces isolated visual assets on demand. The agent follows an "imagine first, then act" workflow, generating assets, writing native HTML/CSS, and refining the design through visual feedback, ultimately producing editable, layer‑wise artifacts with real text that can be adjusted via a graphical interface.
arXiv Computer Vision
Sep 11
Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates
The paper introduces InterIL, a joint generative model that simultaneously produces a background image and a layout of foreground elements for graphic design templates, addressing the limitations of sequential generation approaches. InterIL connects pretrained image and layout diffusion backbones via a learnable communication module, freezing the backbones to preserve prior knowledge while training only the interaction module. The model also offers a test‑time guidance strategy, enabling users to impose preferences without retraining, and demonstrates superior image, layout, and harmonization quality compared to previous methods.
arXiv AI
Jul 28
Design Theater: A Benchmark for Generative UI
arXiv:2607. 22928v1 Announce Type: new Abstract: Generative UI tools promise to democratize UI design by turning natural language descriptions into complete interfaces.
arXiv Machine Learning
Aug 14
From Visual Widgets to UI Code: Efficient Tool-Grounded Generation
arXiv:2608. 12611v1 Announce Type: cross Abstract: Existing screenshot-to-code systems face a trade-off between flexibility and controllability.
arXiv Computer Vision
Sep 3
Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development
RILA is an execution‑driven agent that integrates browser rendering into the generation loop for interactive web development. It uses an Action Interaction Verification module to replay reference interactions on generated pages, collecting execution‑aware observations, and an Execution‑aware Rendering Score to jointly assess interaction correctness and visual fidelity during iterative optimization. A data synthesis pipeline further augments training data, enabling RILA to significantly improve interaction and visual quality across foundation models, even outperforming larger one‑shot generators.
arXiv Machine Learning
Aug 28
Chart2SVG: Editable SVG Generation from Raster Chart Images
Chart2SVG is a multimodal large language model that transforms static raster chart images into editable SVGs enriched with semantic structure. By embedding chart‑specific semantic tokens into a vision‑language framework and training on the Beagle+ dataset of 33K distilled chart samples, the model captures both geometric primitives and their functional roles. The resulting SVGs are visually accurate and structurally consistent, and the accompanying Chart Structure Graph (CSG) exposes visual dependencies for interactive exploration, chart repurposing, and layout reuse.