The paper introduces 3DCodeVerse, a research ecosystem that allows coding agents to generate editable and verifiable 3D content at scale. It comprises a large curated dataset of 3D executable code (3DCodeVerse‑2M), a multi‑agent harness that automatically evaluates and refines generated programs using execution checks and spatial measurements, and empirical studies that establish baselines and practical guidance for 3D coding. Experiments show that fine‑tuning on the dataset improves open‑source models’ 3D coding abilities, and the harness outperforms Claude Design in pairwise human evaluations when used with Claude Opus 5.5.
By Yipeng Gao, Ziyao Zeng, Jinfa Huang, Yijiang Li, Haolin Xiong, Wang Qin, Xinlei Yu, Youheng Yao, Jie Zhang, Kun-Yu Lin, Rong Liu, Yinyuan Zhao, Yajie Zhao, Meiqi Guo, Jiebo Luo, Lei Shu, Yunhao Ge, Xinyu Hu, Laurent Itti
arXiv:2606. 13673v1 Announce Type: cross Abstract: Spatial reasoning, the ability to determine where objects are, how they relate, and how they move in 3D, remains a fundamental challenge for vision-language models (VLMs).
By Seokju Cho, Ryo Hachiuma, Abhishek Badki, Hang Su, Byung-Kwan Lee, Chan Hee Song, Sifei Liu, Subhashree Radhakrishnan, Seungryong Kim, Yu-Chiang Frank Wang, Min-Hung Chen
The paper presents a proof‑of‑concept workflow that uses an AI agent to translate natural‑language prompts into early‑stage structural models. By connecting the agent to a COMPAS‑based structural modelling API via a Model Context Protocol server, the system generates and edits a graph‑based structural data model with explicit building elements. The resulting artifacts can be inspected, modified, serialized, and integrated into downstream AEC workflows, demonstrating the feasibility of combining natural language, agentic workflows, and domain‑specific structural data structures for AI‑assisted structural co‑design.
LLM agents are increasingly used to translate natural language into 3D scenes in a procedural way, but existing systems focus on static output. Dynamic 4D scenes from text alone, in which liquids flow, particles emit, rigid bodies cascade, and articulated mechanisms move, remain largely unexplored despite their value as editable content and as physics-grounded training data for video generation and embodied AI.
arXiv:2601.16520v2 Announce Type: replace-cross
Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress in visual recognition and semantic understanding, yet precise comp...
By Daixian Liu, Jiayi Kuang, Yinghui Li, Yangning Li, Di Yin, Haoyu Cao, Xing Sun, Ying Shen, Hai-Tao Zheng, Liang Lin, Philip S. Yu
The paper introduces LEGO, a benchmark dataset pairing user text descriptions with human‑annotated fine‑grained constraints and reference 3D scenes, and LEGO‑Eval, an evaluation framework that decomposes descriptions into atomic constraints and verifies each using grounding and spatial reasoning tools. It demonstrates that LEGO‑Eval detects misalignment more accurately than existing methods and that current 3D scene synthesis approaches achieve at most a 10% success rate on this benchmark.
By Minseok Kang, Dongwook Choi, Gyeom Hwangbo, Seungwon Lim, Kai Tzu-iunn Ong, Jinyoung Yeo
arXiv:2607. 01766v1 Announce Type: new Abstract: LLM agents are increasingly used to translate natural language into 3D scenes in a procedural way, but existing systems focus on static output.
By Chunjiang Liu, Xiaoyuan Wang, Haoyu Chen, Yizhou Zhao, Ming-Hsuan Yang, L\'aszl\'o A. Jeni
GraFT is a training‑free framework that enhances spatial reasoning in multimodal large language models by integrating a compact 3D scene graph (3DSG). It offers deterministic geometry via symbolic tools, allocentric layout through bird’s‑eye‑view rendering, and visual‑attribute grounding using egocentric frames. Experiments on ScanQA and VSI‑Bench show significant performance gains, with CIDEr increasing by 27% and improvements up to 65% over baseline models.
By Junqing Du, Fernando Ropero, Erkin Turkoz, Yanfeng Zhang, Lu Liu
Design-to-Plan is a large language model–based multi‑agent framework that automates end‑to‑end manufacturing process planning from 3D CAD models and 2D engineering drawings. The system uses an orchestrator to coordinate specialized agents for feature recognition, drawing analysis, context fusion, knowledge retrieval, process sequencing, tool selection, and report generation, integrating deterministic modules with LLM reasoning. Evaluation on 300 benchmark cases shows high success rates, strong tool selection accuracy, effective conflict detection, and reduced token usage, demonstrating the framework’s ability to produce consistent, traceable design‑to‑plan outputs.
By Muhammad Tayyab Khan, Lequn Chen, Wenhe Feng, Seung Ki Moon
The paper introduces ANASSA, an agentic AI orchestration framework designed for spatial intelligence in geographic information systems. It addresses gaps in current systems by integrating structured spatial reasoning, multi‑agent workflow orchestration, execution feedback, authoritative validation, provenance, uncertainty handling, and human decision authority. The architecture is detailed with eleven components across four layers, a six‑step Geospatial AI Cognitive Loop, cross‑component contracts, and governance mechanisms to ensure traceability, reproducibility, and accountability.
By Constantinos Papantoniou, Brian Hilton
arXiv:2608. 05248v1 Announce Type: new Abstract: Generating large-scale, freely explorable 3D worlds from open-ended text remains challenging because a system must jointly maintain global spatial coherence, rich local content, and explicit assets suitable for downstream editing and reuse.
By Chunchao Guo, Jinpeng Li, Yang Li, Zilong Huang
arXiv:2608.24169v1 Announce Type: new
Abstract: 3D geometry editing is a critical yet labor-intensive part of the graphics pipeline, requiring artists to translate creative intent into precise operat...
By Bo Pang, Jiaqi Pan, Xiaocheng Zhang, Jiacheng Xu, Guoping Wang, Peng-Shuai Wang