arXiv AI
Jul 2
Interact3D: Compositional 3D Generation of Interactive Objects
arXiv:2603. 16085v2 Announce Type: replace-cross Abstract: Recent breakthroughs in 3D generation have enabled the synthesis of high-fidelity individual assets.
WorldSculpt: Generating Compositional Worlds from Grounded Videos
WorldSculpt presents a method for generating compositional 3D representations of cluttered scenes with hundreds of objects by adapting a single-object 3D generative prior to multi-view observations. The approach, built on Pixal3D with a multi-view conditioning pathway, can generalize to highly occluded scenes without scene-level training. The authors also introduce the UE-MeshyScene benchmark and demonstrate that their method outperforms prior approaches across various evaluation settings, including converting existing 3DGS worlds into compositional mesh scenes.
Related stories
arXiv AI
Jun 16
SceneConductor: 3D Scene Generation from a Single Image with Multi-Agent Orchestration
arXiv:2606. 08402v2 Announce Type: replace-cross Abstract: Generating complete 3D scenes from a single image requires inferring globally consistent geometry, object relationships, and environmental context from inherently ambiguous visual evidence.
arXiv AI
Jun 9
SceneConductor: 3D Scene Generation from Single Image with Multi-Agent Orchestration
arXiv:2606. 08402v1 Announce Type: cross Abstract: Generating complete 3D scenes from a single image requires inferring globally consistent geometry, object relationships, and environmental context from inherently ambiguous visual evidence.
arXiv Computer Vision
Sep 23
Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction
arXiv:2609.23796v2 Announce Type: replace Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open ch...
arXiv Computer Vision
Sep 22
Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene
arXiv:2609.23796v1 Announce Type: new Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challe...
arXiv Computer Vision
Aug 26
SceneReGen: Generative Reconstruction of 3D Scenes from a Single Image
SceneReGen is a new framework for reconstructing 3D scenes from a single image by generating and assembling complete object meshes within a shared observation‑aligned scene frame. It uses selective pose factorization to encode each object’s observed orientation directly into the generated mesh, while estimating translation and scale from instance‑level and global scene cues. Evaluated on the 3D‑FUTURE dataset, SceneReGen outperforms existing methods on scene‑level metrics and shows strong performance on object‑level metrics, demonstrating its effectiveness in autonomous‑driving and embodied‑AI scenarios.
arXiv Computer Vision
Aug 28
SpatialCrafter: Single Image World Modeling with Generative 3D Proxies
SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.
arXiv Computer Vision
Oct 2
4Director: Controlling Video World Models with Rigid 3D Geometry
arXiv:2610.02160v1 Announce Type: new Abstract: Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through i...
arXiv Machine Learning
Sep 23
CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Image
arXiv:2609.25654v1 Announce Type: cross Abstract: Robots operating safely in cluttered everyday environments often need to infer scene geometry from partial observations. Methods that detect objects...
arXiv Computer Vision
Oct 7
Building Rome from a Single Image
arXiv:2610.08790v1 Announce Type: new Abstract: Single-image scene generation aims to produce a complete 3D scene mesh from a single image, including surfaces the camera did not observe. While pretra...
arXiv Computer Vision
Oct 1
SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images
arXiv:2609.39590v1 Announce Type: new Abstract: Compositional 3D scene generation aims to recover complete 3D object shapes and their spatial arrangement from visual observations. Recent image-condit...
arXiv AI
Jul 2
Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences
arXiv:2607. 00832v1 Announce Type: cross Abstract: A single panorama captures the full visual sphere from one camera center, yet confines users to looking around in place without enabling true scene exploration.