arXiv AI

BrickBench: Evaluating Agentic Brick Design

BrickBench is a new benchmark for evaluating agentic, text‑conditioned LEGO‑set design. In each task, an agent receives a prompt and must produce a physically buildable assembly that meets semantic and design criteria by selecting parts from a discrete library while reasoning about local and global constraints. The benchmark scores designs on validity, alignment, and design across three settings that vary in scale and part availability, and it includes BrickAgent, an environment for coding, inspecting, and validating agent outputs.

arXiv Computer Vision
Oct 23

BrickWright: Agentic Creation of Physically Feasible Brick Builds

BrickWright is a framework that enables coding agents to create physically feasible LEGO brick builds from text or image prompts. It provides a Python toolkit, BrickLayer, which includes an ergonomic assembly API and a validator that checks for real parts, collisions, floating parts, and connectivity. Using BrickWright, agents achieve 100% physical validity on 512 prompts and outperform baseline agents and specialized models on the text-to-brick task.

By Ava Pun, Kevin Dai, Sally Chen, Maxwell Jones, Ruixuan Liu, Kangle Deng, Changliu Liu, Maneesh Agrawala, Deva Ramanan, Jun-Yan Zhu
arXiv AI
Sep 30

Can Agents Design Libraries for Agents?

The paper introduces LibraryDesignBench, a benchmark that tests how well agents can design reusable libraries from specifications without prescribed designs. It evaluates libraries by measuring the correctness and simplicity of programs written by three different user agents across 242 programming problems in four languages. Findings show that while agents often replicate human-designed abstractions, downstream agents still tend to reimplement library features due to rigidity or usability issues, and that providing more prescriptive guidance improves reuse and program simplicity.

By Gabriel Orlanski, Alex L. Zhang, Avi Trost, Vincent Sunn Chen, Frederic Sala, Aws Albarghouthi, Ludwig Schmidt
arXiv AI
Oct 15

Game-Creation-Agents: Autonomous Game Production

arXiv:2610.16776v1 Announce Type: new Abstract: Game-Creation-Agents (GCA) turns a natural-language request into a runnable Phaser 4 browser game. The pipeline first builds a multimodal game design d...

By Tencent Multimodal RL Team, Xiangxin Zhou, Jiaqi Tang, Ke Ma, Wenhao Yang, Jiarui Yao, Boye Niu, Haiyang Guo, Yifei Zhao, Huanjin Yao, Pu Jian, Ruihuang Li, Haitao Wu, Yushi Huang, Xiangyan Liu, Yan Sun, Kaixin Li, Tianyu Pang
arXiv AI
Aug 25

TO-Agents: A Multi-Agent AI Framework for Subjective Preference-Guided Topology Optimization

TO-Agents is a multi‑agent AI framework that translates natural‑language design intent into iterative topology optimization. It converts a human problem description into solver inputs, runs the optimizer, renders 3D topologies, and employs a judge agent to critique and revise results using multiview vision‑language reasoning. Evaluated on a cantilever beam and a phone‑stand design, the system achieved preference‑aligned designs in 60% of trials, outperforming an ablated pipeline by up to six times and enabling end‑to‑end intent‑to‑prototype design with additive manufacturing.

By Isabella A. Stewart, Hongrui Chen, Faez Ahmed
arXiv Computation and Language
Sep 2

Apples on the Table? Evaluating Text-Guided 3D Scene Synthesis via Fine-Grained Constraint Verification

The paper introduces LEGO, a benchmark dataset pairing user text descriptions with human‑annotated fine‑grained constraints and reference 3D scenes, and LEGO‑Eval, an evaluation framework that decomposes descriptions into atomic constraints and verifies each using grounding and spatial reasoning tools. It demonstrates that LEGO‑Eval detects misalignment more accurately than existing methods and that current 3D scene synthesis approaches achieve at most a 10% success rate on this benchmark.

By Minseok Kang, Dongwook Choi, Gyeom Hwangbo, Seungwon Lim, Kai Tzu-iunn Ong, Jinyoung Yeo