arXiv Computer Vision

HARMONY: Hierarchical Agentic Reasoning for MONocular Image-to-Scene Synthesis

HARMONY is a hierarchical chain-of-thought framework that reconstructs complete 3D indoor scenes from a single monocular image. It combines agentic reasoning with visual geometry foundation models, starting with camera calibration and semantic layout recovery, then placing objects hierarchically while refining geometry with point cloud estimations. The method achieves semantically consistent scenes that align perceptually with the input image, outperforming existing baselines on synthetic and real-world data.

arXiv AI
Oct 26

SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning

SceneBloom is an agentic framework that generates realistic, varied, and simulation-ready indoor environments for embodied learning. It combines diffusion-based visual layout sampling with a contract-guided 3D compiler that uses extracted relations for geometric fitting and pose correction. The method outperforms baselines across five room types, achieving higher visual quality, physical stability, and better alignment with real room distributions, and improves object navigation policy success rates on real scans.

By Yuhan Liu, Lianhui Qin, Shenji Wan
arXiv Computer Vision
Oct 15

Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence

arXiv:2610.19502v1 Announce Type: new Abstract: Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominat...

By Yuanyuan Gao, Zhirui Liu, Yuning Gong, Yifei Liu, Yifan Zhan, Kuixuan Jiao, Xiaolong Zhou, Yifan Yang, Hongjie Zhang, Xue Yang, Dan Xu, Zhihang Zhong
arXiv Computer Vision
Oct 28

Learning to Code the World: Harness Evolution for Compositional 3D Reconstruction

The paper introduces SceneEvolve, a framework that represents 3D scenes as executable code and improves reconstruction by evolving a harness around a small open‑source agent. SceneEvolve combines a compositional semantic action interface (SceneAct) with a harness evolution process (SceneHarness‑RSI) that uses a stronger teacher agent for iterative refinement. The resulting harness allows the small Qwen3.8‑27B model to reconstruct unseen scenes without parameter updates, achieving higher reconstruction quality and lower inference time than larger proprietary models across multiple datasets.

By Haoyu Yao, Chenguo Lin, Ruize Du, Yadong Mu
arXiv Computer Vision
Sep 18

SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes

SceneTeract is a verification interface that separates semantic action understanding from physical feasibility in indoor 3D scenes. It decomposes activities into atomic actions and performs explicit geometric checks to determine executability, providing diagnostic traces for failures. The system reveals widespread functional and accessibility issues in synthetic scenes, shows that existing VLMs over‑predict action feasibility, and improves VLM performance through post‑training with verifier feedback, with benefits that generalize to real‑world scenes.

By L\'eopold Maillard, Francis Engelmann, Tom Durand, Boxiao Pan, Yang You, Leonidas Guibas, Maks Ovsjanikov
arXiv Computer Vision
Sep 23

Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning

Fysiverse-3D-Vision is a unified vision‑language‑geometry framework that reconstructs executable 3D scenes from a single image. It separates spatial layout reasoning from asset synthesis, using a shared representation where spatial reasoning and geometric reconstruction reinforce each other. The model employs a Transformer that integrates textual supervision, semantic visual cues, and geometric representations, and includes an object‑conditioned layout module to predict object translation, rotation, and scale while maintaining physical consistency through collision‑aware optimization.

By Dingkang Yang, Yizhou Liu, Wendong Cheng, Zizhi Chen, Shunli Wang, Yang Liu, Hongsheng Li, Lihua Zhang