WAFFLE: Finetuning Multi-Modal Models for Automated Front-End Development
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
FullFront is a new benchmark that evaluates Multimodal Large Language Models (MLLMs) across the entire front‑end engineering workflow, covering webpage design, perception QA, and code generation. It uses a two‑stage process to convert real‑world webpages into clean, standardized HTML, avoiding copyright issues and providing diverse visual designs. Experiments show that current MLLMs struggle with page perception, image handling, layout, and interaction implementation, revealing a large gap compared to human experts.
arXiv:2606. 00154v1 Announce Type: cross Abstract: Recent advancements in multimodal large language models (MLLMs) have achieved remarkable progress in multimodal reasoning and code generation, catalyzing a new paradigm for front-end development.
arXiv:2601. 04203v2 Announce Type: replace-cross Abstract: We present FronTalk, a benchmark for front-end code generation that pioneers the study of a unique interaction dynamic: conversational code generation with multi-modal feedback.
RILA is an execution‑driven agent that integrates browser rendering into the generation loop for interactive web development. It uses an Action Interaction Verification module to replay reference interactions on generated pages, collecting execution‑aware observations, and an Execution‑aware Rendering Score to jointly assess interaction correctness and visual fidelity during iterative optimization. A data synthesis pipeline further augments training data, enabling RILA to significantly improve interaction and visual quality across foundation models, even outperforming larger one‑shot generators.
arXiv:2602.17690v3 Announce Type: replace-cross Abstract: Graphic design generation demands a delicate balance between high visual fidelity and fine-grained structural editability. However, existing...
arXiv:2610.33929v1 Announce Type: new Abstract: Large language models have made remarkable strides in website development, enabling complete and interactive web experiences to be built from natural-l...