MIT News AI

New tool lets users repair AI-generated 3D models, then fabricate them just the way they want

The article introduces "InstructMesh," a new tool that allows users to repair AI-generated 3D models and then fabricate them exactly as desired. It can generate designs for everyday objects that are easy to edit and suitable for both experts and newcomers to 3D modeling.

arXiv AI
1d ago

EditHero: A Benchmark for Long-Horizon Part-Level 3D Editing and Vibe Modeling

EditHero is presented as the first benchmark for long-horizon, part-level 3D editing, featuring natural-language instructions and target images for both geometry and texture. The benchmark uses a deterministic assembly engine that produces the exact target after each edit, and every sequence is manually reviewed. It compares non-agentic top‑down methods with LLM/VLM agent bottom‑up approaches, finding that the latter follow instructions more closely and preserve unedited parts better, though each edit takes minutes.

By Ruihan Yu, Yu-Ju Tsai, Muyao Niu, Runyi Li, Lian Fu, Hanqing Liu, Zheng-Hui Huang, Yonghao Yu, Sho Kuno, Ming-Hsuan Yang, Kaipeng Zhang, Zhixiang Wang
arXiv Computer Vision
4d ago

LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction

LiteReality-Agent is an agentic system that reconstructs real indoor environments into realistic, articulated, and simulation-ready 3D scenes from RGB‑D scans. It treats reconstruction as a coding problem, where a coding agent iteratively edits a Python script (Room.py) using specialized tools, while an observe‑edit‑verify harness ensures evidence gathering, measurement, verification, layout optimisation, simulation readiness, and quality control. The system outperforms recent models like Astra and Fable in geometric accuracy, visual realism, and simulation compatibility, and its modular framework is positioned as a robust foundation for future agent‑driven reconstruction tasks.

By Zhening Huang, Yueyan Li, Johnathan Chiu, Xiaoyang Lyu, Matt Zhou, Yuxin Yao, Joan Lasenby, Shangzhe Wu
arXiv Computer Vision
Aug 28

Procedura: Agentic 3D Modeling with Procedural Control

Procedura is a new 3D modeling agent that treats 3D shape as code, using a large language model to generate a procedural assembly from a text prompt. It constructs an assembly graph, writes a parametric program with named parts and typed mates, and verifies each part through compile, mate, and connectivity checks before adding it. A vision critic refines the assembly step‑by‑step, and the resulting program includes per‑part materials and simulator‑validated articulation, producing sharp edges and editable, part‑structured outputs that outperform existing native 3D generators on P3D‑Bench and MechBench‑36.

By Youtian Lin, Yikang Yang, Zhanpeng Hu, Mengqi Zhou, Feihu Zhang, Xun Cao, Jiaheng Liu, Yao Yao
Hugging Face Trending Papers
Aug 19

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

The paper introduces RoomWright, a code‑driven framework that generates 3D indoor scenes for embodied AI by focusing on functional usage rather than just visual layout. It performs usage‑driven object reasoning, treating anchors as task centers to select task‑required objects and their affordances, and compiles interactions into trigger‑condition‑effect rules that update object states. The system also addresses ambiguous object orientation through annotation‑guided usage cues, producing scenes that are executable, editable, and ready for simulation‑based policy learning.