Hugging Face Blog

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Simon Willison
Sep 13

shot-scraper 1.12

Shot‑scraper 1.12 adds WebP support, allowing users to capture web page screenshots in WebP format with an optional quality setting. The new --quality flag controls compression, while omitting it produces lossless images. WebP screenshots are reported to be significantly smaller than JPEG or PNG equivalents.

arXiv AI
Jun 30

Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation

arXiv:2606. 28593v1 Announce Type: cross Abstract: While recent vision-language models (VLMs) have achieved significant improvements on static visual-to-code tasks such as generating code for webpages, charts, or SVGs, it remains unclear whether they can recover temporal dynamics when motion is present.

By Anya Ji, Abhijith Varma Mudunuri, David M. Chan, Alane Suhr
arXiv Machine Learning
Aug 20

Visual-Aware Representation of Web Pages for Machine Learning Applications

The paper introduces a platform that renders web pages using FitLayout and captures their visual and structural properties in an RDF-based representation. The system offers a REST API for pipeline control, SPARQL queries for data retrieval, and a Python client to integrate with machine learning workflows. It demonstrates how rendered pages can be converted into graph representations to train graph neural networks for key content recognition, highlighting reproducibility and dataset sharing.

By Radek Burget, Radek Hranick\'y
arXiv AI
Jun 30

PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation

arXiv:2606. 28344v1 Announce Type: cross Abstract: Augmenting large language models (LLMs) with retrieved web text has become a dominant paradigm, yet the web is not natively textual: existing systems depend on complex parsing pipelines that linearize HTML and discard layout, visual structure, and formatting.

By Yichuan Wang, Zhifei Li, Zirui Wang, Paul Teiletche, Lesheng Jin, Matei Zaharia, Joseph E. Gonzalez, Sewon Min