The paper introduces a new inference architecture for vibe design agents that separates design exploration from implementation. By generating structured design specifications with typicality scores and selecting one for downstream generation, the method allows users to explore coherent UI alternatives without altering the underlying generation settings. Experiments on UI themes and visual-asset prompts show increased selection coverage and screenshot variation, with mixed preferences from an LLM judge and modest operational costs in a large online test.
arXiv:2607. 23126v1 Announce Type: cross Abstract: Generative AI design tools make natural-language prompts a starting point for design, placing new articulation demands on designers.
arXiv:2607. 22928v1 Announce Type: new Abstract: Generative UI tools promise to democratize UI design by turning natural language descriptions into complete interfaces.
Editable Visual Design introduces a new design paradigm that combines a Coding Agent with a Vision‑Language Model (VLM) and an image generation model. The VLM acts as the creative brain, understanding requirements, planning tasks, and judging aesthetics, while the image generator produces isolated visual assets on demand. The agent follows an "imagine first, then act" workflow, generating assets, writing native HTML/CSS, and refining the design through visual feedback, ultimately producing editable, layer‑wise artifacts with real text that can be adjusted via a graphical interface.
EvoDesign is an agentic framework that enables editable diagram creation by constructing a diagram manifest through coordinated structure, style, and layout agents, then rendering it in a diagnostic verification environment that provides defect signals and VLM-based critique. The system uses an evolution mechanism to distill refinement traces into a three-tier design expertise memory, promoting strategies only with repeated cross-context support. CanvasBench, a new benchmark and evaluation protocol, assesses content, visual, and cognitive dimensions, and experiments show EvoDesign achieves a strong balance across content fidelity, visual organization, and cognitive usability compared to pixel, code-based, agentic, one-shot schema, and canvas-native methods.
arXiv:2609.36593v1 Announce Type: cross Abstract: Creating diverse physical simulations remains labor-intensive because assets, layout, physical parameters, motion, control, and rendering must be des...
arXiv:2603. 13312v2 Announce Type: replace-cross Abstract: Interior design is a requirements-to-visual-plan generation process that must simultaneously satisfy verifiable spatial feasibility and comparative aesthetic preferences.
The paper introduces Design Creativity Bench, a benchmark for evaluating creativity in large language model (LLM)-generated user interface (UI) designs. It measures originality (distinctiveness among models on the same prompt), creative range (how designs vary across prompts for the same UI goal), and appropriateness (how many brief criteria each design meets). Results show LLMs produce designs that are generally appropriate but far less original and varied than human designs, indicating a need for stronger measures to address this limitation.
arXiv:2607. 23126v2 Announce Type: replace-cross Abstract: The rapid adoption of generative AI tools has created new literacy demands for designers who must verbalize tacit knowledge through natural language prompts.
Design Creativity Bench is a new benchmark that evaluates the diversity and appropriateness of UI designs generated by large language models (LLMs). It measures originality (distinctiveness among models on the same prompt), creative range (how much designs change between prompts for the same UI goal), and appropriateness (how many brief criteria each design meets). The benchmark shows that LLMs produce designs that are far less original and less varied than human designs, though they are generally appropriate.
arXiv:2610.18860v1 Announce Type: new Abstract: Generating information-rich visual artifacts such as slides, posters, and dashboards as code is appealing because the outputs are structured, editable,...
arXiv:2607. 03731v1 Announce Type: cross Abstract: Creating 3D assets for virtual reality requires modeling expertise, which restricts the authorship of immersive experiences.
arXiv:2608. 12611v1 Announce Type: cross Abstract: Existing screenshot-to-code systems face a trade-off between flexibility and controllability.