arXiv Computer Vision

Finetuning Prompt-Based Image Editor for Geometry-Consistent Room Defurnishing

arXiv Computer Vision
Sep 23

HARMONY: Hierarchical Agentic Reasoning for MONocular Image-to-Scene Synthesis

HARMONY is a hierarchical chain-of-thought framework that reconstructs complete 3D indoor scenes from a single monocular image. It combines agentic reasoning with visual geometry foundation models, starting with camera calibration and semantic layout recovery, then placing objects hierarchically while refining geometry with point cloud estimations. The method achieves semantically consistent scenes that align perceptually with the input image, outperforming existing baselines on synthetic and real-world data.

By Shufan Sun, Chen Wang, Enxin Song, Jiatao Gu, Lingjie Liu
arXiv AI
Oct 26

SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning

SceneBloom is an agentic framework that generates realistic, varied, and simulation-ready indoor environments for embodied learning. It combines diffusion-based visual layout sampling with a contract-guided 3D compiler that uses extracted relations for geometric fitting and pose correction. The method outperforms baselines across five room types, achieving higher visual quality, physical stability, and better alignment with real room distributions, and improves object navigation policy success rates on real scans.

By Yuhan Liu, Lianhui Qin, Shenji Wan
arXiv Computer Vision
Oct 7

DistScene: Object-to-Scene Distillation for 3D Scene Generation

DistScene is a framework for generating 3D scenes from a single image by jointly modeling the environment and individual objects. It introduces Scene-Frame Generation to produce separate environment and object components in a shared coordinate frame, and Object-Centric Refinement to fine‑tune each object with scene context. The method also employs Object-to-Scene Distillation to transfer pretrained object-generation priors to scene generation using automatically composed synthetic scenes, achieving improved spatial coherence on indoor and outdoor benchmarks.

By Kunming Luo, Hongyu Yan, Ken Deng, Chengcheng Zhou, Tianyu Liu, Haipeng Li, Haibin Huang, Xuelong Li, Ping Tan
arXiv Computer Vision
Oct 9

3DTexMOR: 3D Gaussian Multi-Object Removal via Texture-Space Inpainting

3DTexMOR introduces a method for removing multiple 3D objects from reconstructed scenes by performing texture-space inpainting rather than 2D image inpainting. The approach aggregates observations into shared texture maps, inpaints missing regions, and reprojects the completed maps to supervise Gaussian scene completion, while decomposing appearance to avoid view-dependent artifacts. Experiments show that this technique yields visually plausible results and outperforms existing methods, improving PSNR by 5.8 dB and reducing LPIPS by at least 22%.

By Kunxin Guang, Yonghao Zhao, Jian Yang, Beibei Wang