arXiv Computer Vision

FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation

arXiv Computer Vision
4d ago

SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RL

SceneReVis is a vision‑grounded, self‑reflective framework for 3D indoor scene synthesis that uses an iterative diagnose‑and‑act loop to detect and fix spatial conflicts such as collisions. It introduces SceneChain‑12k, a large dataset of causal construction trajectories generated via a reverse engineering pipeline, and employs a two‑stage training recipe that moves from supervised fine‑tuning to agentic reinforcement learning, turning the model into an active spatial planner. Experiments show that SceneReVis achieves state‑of‑the‑art performance in high‑fidelity generation and goal‑oriented optimization, with better transfer to underrepresented room categories and potential for out‑of‑distribution room types.

By Yang Zhao, Shizhao Sun, Meisheng Zhang, Yingdong Shi, Xubo Yang, Jiang Bian
arXiv Computation and Language
Sep 1

PlanCraft: Sketch, Refine, and Furnish for Architect-Inspired Progressive 3D Residential Scene Generation

PlanCraft introduces a progressive approach to 3D residential scene generation that mirrors how architects design: starting with rough sketches and refining them over time. It leverages a large dataset of real floor plans to train a SketchPlan module that generates partial sketches at various completion levels, a PlanCraft‑Diff module that sharpens these sketches into precise vector floor plans, and a PlanCraft‑Agent that furnishes rooms within the established spatial contract. The method outperforms existing 2D and 3D baselines, achieving a 61.1% lower FID and a 15‑point lead in expert‑rated spatial rationality, even with only 25% sketch completion.

By Pengyu Zeng, Yuqin Dai, Jun Yin, Ziyang Han, Ng Cheuk Hei, Jing Zhong, Chaoyang Shi, ZhanXiang Jin, Maowei Jiang, Shuai Lu
Hugging Face Trending Papers
Jul 15

ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning

While traditional graphics methods often synthesize 3D indoor scenes autoregressively or hierarchically, recent vision-language model (VLM)-based generators predominantly adopt a one-shot paradigm where the full layout is planned at once. This one-shot approach often requires global re-optimization or complete reconstruction during interactive editing (e.

arXiv AI
Sep 1

ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

ScenePilot introduces a retrieval‑augmented Grow‑and‑Repair framework for text‑driven 3D indoor scene generation. It uses a Hierarchical Retrieval‑Augmented Planning module to fetch room, group, and anchor layout priors, then incrementally inserts object groups with a base generator, while a Reinforcement Multimodal Repair module performs lightweight local corrections after each insertion and a final global repair. The approach is trained on a new SceneReverse‑17k dataset of perturbed scenes, enabling the policy to predict structured move‑rotate‑scale actions from rendered views, scene state, retrieved priors, and edit history, thereby improving physical plausibility, functional coherence, and controllability without heavy full‑scene optimization.

By Jiawei Zhang, Hongsong Wang, Pan Zhou
Hugging Face Trending Papers
Aug 19

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

The paper introduces RoomWright, a code‑driven framework that generates 3D indoor scenes for embodied AI by focusing on functional usage rather than just visual layout. It performs usage‑driven object reasoning, treating anchors as task centers to select task‑required objects and their affordances, and compiles interactions into trigger‑condition‑effect rules that update object states. The system also addresses ambiguous object orientation through annotation‑guided usage cues, producing scenes that are executable, editable, and ready for simulation‑based policy learning.

arXiv Computation and Language
4d ago

RenoLayout: Unified Floorplan Renovation and Furniture Layout for Constraint-Aware Residential Design

RenoLayout is a new framework that unifies floorplan renovation and furniture layout for residential design. It takes an existing residential layout and a set of design points, then generates a Geometry-as-Code program that preserves immutable structural elements while optimizing furniture placement under design objectives and physical constraints. The authors also introduce a Design Map with 123 fine‑grained design points, a Difference‑Grounded Design‑Point Annotation method, and a three‑stage training pipeline (CPT–SFT–RL) to improve spatial reasoning, instruction following, and constraint compliance. Additionally, they present the RenoLayout Benchmark, a collection of 200 real‑world before‑after renovation cases with complete furniture layouts, marking the first benchmark for unified residential design.

By Jingguo Liu, Yuanqing Liu, Chong Zhang, Yue Yang
arXiv AI
Jul 28

GFLAN: Generative Functional Layouts

arXiv:2512. 16275v2 Announce Type: replace-cross Abstract: Automated floor plan generation lies at the intersection of combinatorial search, geometric constraint satisfaction, and functional design requirements -- a confluence that has historically resisted a unified computational treatment.

By Mohamed Abouagour, Eleftherios Garyfallidis