Hugging Face Trending Papers

CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Image

arXiv AI
Sep 24

MessyKitchens: Contact-rich object-level 3D scene reconstruction

MessyKitchens introduces a new dataset of cluttered real-world kitchen scenes with detailed 3D object shapes, poses, and accurate contact information. The authors extend the SAM 3D single-object reconstruction method with a Multi-Object Decoder (MOD) to jointly reconstruct entire scenes, achieving better registration accuracy and reduced inter-object penetration compared to prior work. The dataset, benchmark, code, and pretrained models will be publicly released on the project website.

By Junaid Ahmed Ansari, Ran Ding, Fabio Pizzati, Ivan Laptev
arXiv Computer Vision
Sep 7

WorldSculpt: Generating Compositional Worlds from Grounded Videos

WorldSculpt presents a method for generating compositional 3D representations of cluttered scenes with hundreds of objects by adapting a single-object 3D generative prior to multi-view observations. The approach, built on Pixal3D with a multi-view conditioning pathway, can generalize to highly occluded scenes without scene-level training. The authors also introduce the UE-MeshyScene benchmark and demonstrate that their method outperforms prior approaches across various evaluation settings, including converting existing 3DGS worlds into compositional mesh scenes.

By Muyao Niu, Jixuan He, Ruihan Yu, Lian Fu, Yonghao Yu, Zheng-Hui Huang, Yifan Zhan, Fengbo Lan, Yongtao Ge, Yinqiang Zheng, Kaipeng Zhang, Zhixiang Wang
arXiv AI
Oct 26

Easy-3Dfy: Object-Level Geometric Composition for Single-Image 3D Scene Construction

Easy-3Dfy introduces a compositional workflow for single-image 3D scene construction that separates object generation from scene layout estimation. By using a specialized 3D object generator for detailed geometry and a 3D foundation model for spatial understanding, the method aligns object-local meshes with partial scene pointmaps via an RPF-based aligner. This approach consistently outperforms SAM-3Dfy on geometric metrics in Scene-Maker and 3D-FUTURE200 without requiring full scene-level supervision.

By Ziang Zhang, Wenyou Yi, Zehan Wang, Jiachen Xu, Xintong Han, Chunchao Guo, Zhou Zhao
arXiv Computer Vision
Aug 26

SceneReGen: Generative Reconstruction of 3D Scenes from a Single Image

SceneReGen is a new framework for reconstructing 3D scenes from a single image by generating and assembling complete object meshes within a shared observation‑aligned scene frame. It uses selective pose factorization to encode each object’s observed orientation directly into the generated mesh, while estimating translation and scale from instance‑level and global scene cues. Evaluated on the 3D‑FUTURE dataset, SceneReGen outperforms existing methods on scene‑level metrics and shows strong performance on object‑level metrics, demonstrating its effectiveness in autonomous‑driving and embodied‑AI scenarios.

By Zefan Tian, Yuteng Ye, Yiheng Zhang, Yuhang Yang, Xueqiang Lv, Shizhou Zhang, Le Liu, Di Xu
arXiv Computer Vision
1d ago

Open-World Scene Deocclusion

arXiv:2611.17695v1 Announce Type: new Abstract: Recovering the complete appearance of occluded objects from a single image is a fundamental problem for scene understanding and image editing. Real-wor...

By K. M. S. J. Kumarasinghe, Neil A. Dodgson, Fang-Lue Zhang
Hugging Face Trending Papers
Nov 2

CoLa3D: Composable Latent 3D Decomposition

CoLa3D is a lightweight, query‑based transformer that performs composable 3D scene decomposition directly from a single whole‑scene latent, whether derived from an image or an existing mesh. It outputs a set of object meshes with a consistent spatial layout that can be reassembled into a coherent scene, avoiding fragile pose and scale estimation used by other methods. The model achieves state‑of‑the‑art performance on synthetic and real‑world datasets, improving global scene consistency and object quality while running twice as fast and using less than 1% of SAM 3D’s training data.