arXiv Machine Learning
5d ago
From Visual Widgets to UI Code: Efficient Tool-Grounded Generation
arXiv:2608. 12611v1 Announce Type: cross Abstract: Existing screenshot-to-code systems face a trade-off between flexibility and controllability.
Design Theater: A Benchmark for Generative UI
arXiv:2607. 22928v1 Announce Type: new Abstract: Generative UI tools promise to democratize UI design by turning natural language descriptions into complete interfaces.
Related stories
arXiv Machine Learning
Jun 2
Design-MLLM: A Reinforcement Alignment Framework for Verifiable and Aesthetic Interior Design
arXiv:2603. 13312v2 Announce Type: replace-cross Abstract: Interior design is a requirements-to-visual-plan generation process that must simultaneously satisfy verifiable spatial feasibility and comparative aesthetic preferences.
arXiv AI
Jul 15
1D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-World
arXiv:2602. 18548v2 Announce Type: replace-cross Abstract: Design-to-code translates high-fidelity UI designs into executable front-end implementations, but progress remains hard to compare due to inconsistent datasets, toolchains, and evaluation protocols.
arXiv Machine Learning
Jun 5
Do MLLMs Capture How Interfaces Guide User Behavior? A Benchmark for Multimodal UI/UX Design Understanding
arXiv:2505. 05026v5 Announce Type: replace-cross Abstract: User interface (UI) design goes beyond visuals to shape user experience (UX), underscoring the shift toward UI/UX as a unified concept.
arXiv AI
Jun 6
MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation
arXiv:2605. 28579v2 Announce Type: replace Abstract: Large language models (LLMs) have recently advanced text-driven 3D generation, yet Text-to-CAD remains far from supporting industrial product design.
arXiv AI
Jun 12
VISTA: An End-to-End Benchmark for Visual Spec-to-Web-App Coding Agents
arXiv:2605. 26144v2 Announce Type: replace-cross Abstract: We present VISTA (VIsual Spec-To-App Benchmark), a benchmark for evaluating the end-to-end web-app generation capabilities of LLM-based agents.
Hugging Face Trending Papers
Jul 7
UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation
Large language models (LLMs) have demonstrated growing competence in web page generation. However, existing text-driven approaches rely on complex prompts that impose substantial demands on users and offer limited expressivity for page layout and cross-page visual coherence.
arXiv AI
Jul 28
From Vibe to Code -- and Back: Lexical Oscillation in the Formation of Design Intent with Generative AI
arXiv:2607. 23126v1 Announce Type: cross Abstract: Generative AI design tools make natural-language prompts a starting point for design, placing new articulation demands on designers.
arXiv AI
Jul 8
UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation
arXiv:2607. 06306v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated growing competence in web page generation.
arXiv AI
Jul 8
Foundation Models for Automatic CAD Generation
arXiv:2607. 05573v1 Announce Type: new Abstract: Recent advances in Large Language Models (LLMs) and Vision-Language Models (VLMs) enable the automatic generation of parametric 3D designs from natural-language specifications.
arXiv AI
Jun 12
Reasoning for Mobile User Experience with Multimodal LLMs: Task, Benchmark, and Approach
arXiv:2606. 13192v1 Announce Type: new Abstract: User experience (UX) centered on usability, perceived consistency, and functional clarity is fundamental to real-world user interfaces (UI).
arXiv AI
Jul 14
Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Control
arXiv:2607. 10405v1 Announce Type: cross Abstract: Controlling attributes is a critical step toward achieving the final creative outcome, yet current approaches fall short in supporting users in the iterative refinement of generative content.