arXiv AI
Jul 28
Design Theater: A Benchmark for Generative UI
arXiv:2607. 22928v1 Announce Type: new Abstract: Generative UI tools promise to democratize UI design by turning natural language descriptions into complete interfaces.
Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Control
arXiv:2607. 10405v1 Announce Type: cross Abstract: Controlling attributes is a critical step toward achieving the final creative outcome, yet current approaches fall short in supporting users in the iterative refinement of generative content.
Related stories
arXiv AI
Sep 2
Solaris: Towards Interfaces That Are Generated, Not Coded
arXiv:2609.00776v1 Announce Type: cross Abstract: Digital interfaces are traditionally implemented through intermediate representations such as code, requiring their appearance and behavior to be spe...
arXiv AI
Jun 19
DataMagic: Transforming Tabular Data into Data Insight Video
arXiv:2606. 20388v1 Announce Type: cross Abstract: Data videos integrate dynamic charts, voice narration, and synchronized animations to communicate data insights as temporal narratives, making them an effective medium for improving data consumption efficiency in the data management lifecycle.
arXiv Computer Vision
Sep 1
SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objects
arXiv:2608.18560v2 Announce Type: replace-cross Abstract: Fine-grained control over continuous semantic attributes of 3D objects is essential for 3D content creation, but is not well supported by con...
Hugging Face Trending Papers
Aug 19
SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objects
Fine-grained control over continuous semantic attributes of 3D objects is essential for 3D content creation, but is not well supported by conventional 3D modeling workflows or prompt-based interaction...
arXiv AI
Sep 23
Generative Tutorial: Towards Live Contextualized Visual Instructions for Physical Tasks
arXiv:2609.24955v1 Announce Type: cross Abstract: Visual instructions for physical tasks are typically authored in one context and followed in another, requiring users to translate demonstrated tools...
arXiv AI
Jul 24
GS-Agent: Creating 4D Physical Worlds With Generative Simulation
arXiv:2607. 21522v1 Announce Type: cross Abstract: Creating dynamic and physically realistic 4D worlds from natural language descriptions is both fascinating and challenging.
arXiv AI
Jun 30
SWITCH: Benchmarking Modeling and Handling of Tangible Interfaces in Long-horizon Embodied Scenarios
arXiv:2511. 17649v4 Announce Type: replace-cross Abstract: Tangible control interfaces (TCIs), such as appliance panels, remotes, elevators, and embedded GUIs, are a fundamental component of everyday human-built environments.
arXiv AI
Aug 13
Empowering Children to Create AI-Enabled Augmented Reality Experiences
arXiv:2508. 08467v2 Announce Type: replace-cross Abstract: Despite their potential to enhance children's learning experiences, AI-enabled AR technologies are predominantly used in ways that position children as consumers rather than creators.
arXiv Computer Vision
Aug 25
DesignAgent3D: Interactive 3D Scene Editing via Designer-like Multimodal Reasoning
arXiv:2608.21438v1 Announce Type: new Abstract: Text guided 3D scene editing provides an intuitive interface for modifying reconstructed environments, but remains difficult because natural language d...
arXiv Computer Vision
Aug 26
ViSculpt: Visual-Centric Agentic Geometry Editing
arXiv:2608.24169v1 Announce Type: new Abstract: 3D geometry editing is a critical yet labor-intensive part of the graphics pipeline, requiring artists to translate creative intent into precise operat...
arXiv Computation and Language
Sep 4
Editable Visual Design
Editable Visual Design introduces a new design paradigm that combines a Coding Agent with a Vision‑Language Model (VLM) and an image generation model. The VLM acts as the creative brain, understanding requirements, planning tasks, and judging aesthetics, while the image generator produces isolated visual assets on demand. The agent follows an "imagine first, then act" workflow, generating assets, writing native HTML/CSS, and refining the design through visual feedback, ultimately producing editable, layer‑wise artifacts with real text that can be adjusted via a graphical interface.