arXiv Computer Vision By Haoyu Yao, Chenguo Lin, Ruize Du, Yadong Mu

Learning to Code the World: Harness Evolution for Compositional 3D Reconstruction

Read the original on arXiv Computer Vision →

The paper introduces SceneEvolve, a framework that represents 3D scenes as executable code and improves reconstruction by evolving a harness around a small open‑source agent. SceneEvolve combines a compositional semantic action interface (SceneAct) with a harness evolution process (SceneHarness‑RSI) that uses a stronger teacher agent for iterative refinement. The resulting harness allows the small Qwen3.8‑27B model to reconstruct unseen scenes without parameter updates, achieving higher reconstruction quality and lower inference time than larger proprietary models across multiple datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 23

HARMONY: Hierarchical Agentic Reasoning for MONocular Image-to-Scene Synthesis

HARMONY is a hierarchical chain-of-thought framework that reconstructs complete 3D indoor scenes from a single monocular image. It combines agentic reasoning with visual geometry foundation models, starting with camera calibration and semantic layout recovery, then placing objects hierarchically while refining geometry with point cloud estimations. The method achieves semantically consistent scenes that align perceptually with the input image, outperforming existing baselines on synthetic and real-world data.

By Shufan Sun, Chen Wang, Enxin Song, Jiatao Gu, Lingjie Liu
arXiv Computer Vision
Sep 7

WorldSculpt: Generating Compositional Worlds from Grounded Videos

WorldSculpt presents a method for generating compositional 3D representations of cluttered scenes with hundreds of objects by adapting a single-object 3D generative prior to multi-view observations. The approach, built on Pixal3D with a multi-view conditioning pathway, can generalize to highly occluded scenes without scene-level training. The authors also introduce the UE-MeshyScene benchmark and demonstrate that their method outperforms prior approaches across various evaluation settings, including converting existing 3DGS worlds into compositional mesh scenes.

By Muyao Niu, Jixuan He, Ruihan Yu, Lian Fu, Yonghao Yu, Zheng-Hui Huang, Yifan Zhan, Fengbo Lan, Yongtao Ge, Yinqiang Zheng, Kaipeng Zhang, Zhixiang Wang
arXiv Computer Vision
Oct 16

GRASE: Geometry-native Real-to-sim Agentic Scene Modeling from Video

GRASE is a new agentic framework for converting real-world video into editable 3D scenes while preserving geometry and layout. It treats captured multi‑view video as a persistent reference, revising intermediate hypotheses whenever rendered evidence conflicts with the capture. By iteratively refining architectural shells, asset placement, and geometry with cross‑view feedback, GRASE produces faithful, consistent scenes that outperform existing state‑of‑the‑art methods.

By Zhaorui Lin, Haohan Liu, Zhen Chen, Xiangru Huang