arXiv AI
Jul 28
Design Theater: A Benchmark for Generative UI
arXiv:2607. 22928v1 Announce Type: new Abstract: Generative UI tools promise to democratize UI design by turning natural language descriptions into complete interfaces.
Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Control
arXiv:2607. 10405v1 Announce Type: cross Abstract: Controlling attributes is a critical step toward achieving the final creative outcome, yet current approaches fall short in supporting users in the iterative refinement of generative content.
Related stories
arXiv AI
Jun 19
DataMagic: Transforming Tabular Data into Data Insight Video
arXiv:2606. 20388v1 Announce Type: cross Abstract: Data videos integrate dynamic charts, voice narration, and synchronized animations to communicate data insights as temporal narratives, making them an effective medium for improving data consumption efficiency in the data management lifecycle.
arXiv AI
Jul 24
GS-Agent: Creating 4D Physical Worlds With Generative Simulation
arXiv:2607. 21522v1 Announce Type: cross Abstract: Creating dynamic and physically realistic 4D worlds from natural language descriptions is both fascinating and challenging.
arXiv AI
Jun 30
SWITCH: Benchmarking Modeling and Handling of Tangible Interfaces in Long-horizon Embodied Scenarios
arXiv:2511. 17649v4 Announce Type: replace-cross Abstract: Tangible control interfaces (TCIs), such as appliance panels, remotes, elevators, and embedded GUIs, are a fundamental component of everyday human-built environments.
arXiv AI
6d ago
Empowering Children to Create AI-Enabled Augmented Reality Experiences
arXiv:2508. 08467v2 Announce Type: replace-cross Abstract: Despite their potential to enhance children's learning experiences, AI-enabled AR technologies are predominantly used in ways that position children as consumers rather than creators.
arXiv AI
Jul 7
CoGen3D: An Agentic Human-AI Co-Design Pipeline for 3D Asset Generation for Virtual Reality
arXiv:2607. 03731v1 Announce Type: cross Abstract: Creating 3D assets for virtual reality requires modeling expertise, which restricts the authorship of immersive experiences.
arXiv AI
Jul 8
CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
arXiv:2607. 05465v1 Announce Type: cross Abstract: Complex image creation and editing often require more than a single generation or editing model.
arXiv AI
Jun 12
Mana: Dexterous Manipulation of Articulated Tools
arXiv:2606. 13677v1 Announce Type: cross Abstract: Articulated tool manipulation remains a major challenge in dexterous robotics due to the need to coordinate internal degrees of freedom and contact-rich interactions.
arXiv AI
Jul 8
FORGE: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoning
arXiv:2607. 05780v1 Announce Type: cross Abstract: While humans readily repurpose a book, a stone, or a shoe to drive a nail, robots trained on specific tools fail to transfer the same function to novel ones -- a gap we formalize as functional generalization.
Hugging Face Trending Papers
Jul 20
SEE: Structure-aware Exploring \& Exploiting for Long-horizon GUI Agent Trajectory Synthesis
Graphical User Interface (GUI) agents powered by vision-language models hold promise for automating real-world mobile tasks. However, progress is limited by the lack of high-coverage, long-horizon interaction trajectories collected from element-rich and rapidly evolving apps.
arXiv AI
Jul 9
SPEAR: A Simulator for Photorealistic Embodied AI Research
arXiv:2607. 06701v1 Announce Type: cross Abstract: Interactive simulators have become powerful tools for training embodied agents and generating synthetic visual data, but existing photorealistic simulators suffer from limited generality, programmability, and rendering speed.
arXiv AI
Jun 18
Guava: An Effective and Universal Harness for Embodied Manipulation
arXiv:2606. 18363v1 Announce Type: cross Abstract: Language models trained on large-scale vision-language data have demonstrated strong potential for embodied agents.