The paper introduces 3DCodeVerse, a research ecosystem that allows coding agents to generate editable and verifiable 3D content at scale. It comprises a large curated dataset of 3D executable code (3DCodeVerse‑2M), a multi‑agent harness that automatically evaluates and refines generated programs using execution checks and spatial measurements, and empirical studies that establish baselines and practical guidance for 3D coding. Experiments show that fine‑tuning on the dataset improves open‑source models’ 3D coding abilities, and the harness outperforms Claude Design in pairwise human evaluations when used with Claude Opus 5.5.
By Yipeng Gao, Ziyao Zeng, Jinfa Huang, Yijiang Li, Haolin Xiong, Wang Qin, Xinlei Yu, Youheng Yao, Jie Zhang, Kun-Yu Lin, Rong Liu, Yinyuan Zhao, Yajie Zhao, Meiqi Guo, Jiebo Luo, Lei Shu, Yunhao Ge, Xinyu Hu, Laurent Itti
arXiv:2609.36380v1 Announce Type: new
Abstract: A 3D scene reconstructed from a single image is most useful when represented not as a rendering or a fixed 3D output, but as an explicit scene program...
By Xirui Li, Peng Shi, Mingwen Dong, Sheng Zhang, Zhuoyan Xu, Dongkyu Lee, Shuaichen Chang, Yi Xiang, Lin Pan, Jiarong Jiang
arXiv:2606. 01057v1 Announce Type: cross Abstract: Procedural 3D modeling through code is emerging as a versatile paradigm, offering deterministic, engine-ready, and precisely editable assets that neural 3D generators inherently lack.
By Yipeng Gao, Lei Shu, Genzhi Ye, Xi Xiong, Ameesh Makadia, Meiqi Guo, Laurent Itti, Jindong Chen
Code4Scene is a benchmark that evaluates coding agents on constructing and editing 3D scenes in Unreal Engine. It tests agents on two tasks: construction, where they must build a scene from open‑ended language, and editing, where they must recover a target scene from reference images while preserving everything else. The benchmark measures task fulfillment, artifact integrity, and physical validity, revealing that construction and editing performance are correlated but not interchangeable, with agents struggling most with spatial composition and precise edits.
By Xiaokang Ye, Siddhant Hitesh Mantri, Zimeng Chen, Edward Zhang, Zhaoxu Zheng, Yuanheng Li, Yizhao Chen, Tianyang Huang, Lianhui Qin
Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver. We present NeoWorld-3, a coding-agent framework tha...
arXiv:2610.27690v1 Announce Type: new
Abstract: Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver. We...
By Eachen Soong, Zijian Niu, Haoran Xu, Yihong Dong, Yunbo Wang, Xiaokang Yang
Most recent 3D reconstruction and editing systems operate on implicit and explicit representations such as NeRF, point clouds, or meshes. While these representations enable high-fidelity rendering, they are fundamentally low-level and hard to control programmatically.
arXiv:2605. 10873v2 Announce Type: replace-cross Abstract: Recovering editable CAD programs from images or 3D observations is central to AI-assisted design, but progress is difficult to measure because existing evaluations are fragmented across datasets, modalities, and metrics.
By Anna C. Doris, Jacob Thomas Sony, Ghadi Nehme, Era Syla, Amin Heyrani Nobari, Faez Ahmed
The paper introduces SceneEvolve, a framework that represents 3D scenes as executable code and improves reconstruction by evolving a harness around a small open‑source agent. SceneEvolve combines a compositional semantic action interface (SceneAct) with a harness evolution process (SceneHarness‑RSI) that uses a stronger teacher agent for iterative refinement. The resulting harness allows the small Qwen3.8‑27B model to reconstruct unseen scenes without parameter updates, achieving higher reconstruction quality and lower inference time than larger proprietary models across multiple datasets.
By Haoyu Yao, Chenguo Lin, Ruize Du, Yadong Mu
arXiv:2610.04432v2 Announce Type: replace
Abstract: Building interactive simulators from real-world observations is a promising way to scale embodied data, but current pipelines still rely heavily on...
By Jinzhou Tang, Zijun Zhang, Jing Yang, Yuchen Yan, Kun Zhou, Lingjun Mao, Ruobing Han, Jinglin Cao, Wenpeng Xu, Lukun He, Minghao Fu, Fan Feng, Biwei Huang
WorldAct is a framework that transforms static, monolithic 3D worlds generated by systems like Marble into editable, interaction‑ready scenes. It employs a multimodal agent to decompose the scene, identify actionable objects, reconstruct object‑level meshes, and inpaint the remaining background. The resulting scenes allow object‑level editing, collision‑aware manipulation, and embodied task execution while maintaining global coherence.
By Jichen Hu, Jiawei Guo, Jiazhong Cen, Chen Yang, Sikuang Li, Wei Shen
arXiv:2606. 08402v2 Announce Type: replace-cross Abstract: Generating complete 3D scenes from a single image requires inferring globally consistent geometry, object relationships, and environmental context from inherently ambiguous visual evidence.
By Jeonghwan Kim, Yushi Lan, Yongwei Chen, Hieu Trung Nguyen, Chuanyu Pan, Xingang Pan