arXiv Computer Vision
Oct 16

RoboCloth: A Large-Scale Real Cloth Material Dataset for Neural Reflectance Reconstruction

RoboCloth is a new dataset comprising 500 real cloth materials captured with robotically controlled cameras and lighting. Each material is imaged in about 580 high‑dynamic‑range frames across a wide view‑light hemisphere, with camera poses refined via structure‑from‑motion and aligned to the robot frame to provide per‑material sparse geometry and structured reflectance observations. The authors use this data to train a two‑stage neural reconstruction pipeline, demonstrating that a decoder trained on RoboCloth outperforms those trained on existing datasets and analytic PBR fitting, and transfers well to unseen acquisition systems.

By Zhen Li (Simon Fraser University), Haoran Qin (Westlake University), Francesco Di Sario (University of Torino,Simon Fraser University), Daniel Rebain (University of British Columbia,Wayve), Andrea Tagliasacchi (Simon Fraser University, Wayve,University of Toronto)
arXiv AI
Sep 24

MessyKitchens: Contact-rich object-level 3D scene reconstruction

MessyKitchens introduces a new dataset of cluttered real-world kitchen scenes with detailed 3D object shapes, poses, and accurate contact information. The authors extend the SAM 3D single-object reconstruction method with a Multi-Object Decoder (MOD) to jointly reconstruct entire scenes, achieving better registration accuracy and reduced inter-object penetration compared to prior work. The dataset, benchmark, code, and pretrained models will be publicly released on the project website.

By Junaid Ahmed Ansari, Ran Ding, Fabio Pizzati, Ivan Laptev
Hugging Face Trending Papers
Jul 20

FF-ProCams: Feed-Forward Gaussian Splatting for Projector-Camera System

Projector-camera (ProCams) systems achieve active scene perception and controllable appearance manipulation via structured illumination, serving as a core infrastructure for spatial augmented reality, projection mapping, and surface reflectance acquisition. Existing inverse-rendering methods for ProCams deliver high-fidelity results but rely on time-consuming per-scene optimization, while mainstream feed-forward 3D reconstruction models produce baked appearance that cannot adapt to spatially varying projector illumination.

arXiv Computer Vision
Oct 2

GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking

GenCOPE introduces a synthetic-to-real (Syn2Real) approach for category-level object pose estimation (COPE) that eliminates the need for labor-intensive real-world data collection. By learning domain-invariant representations through 2D and 3D semantic consistency constraints and employing an end-to-end pose regression framework with 2D-3D cross consistency, the model achieves robust generalization across synthetic and real domains. The architecture relies solely on global features, resulting in a lightweight and efficient design validated on REAL275, Wild6D, and real-world robotic manipulation scenes.

By Jian Liu, Wei Sun, Zhenqi Dai, Hui Yang, Jian Xiao, Nicu Sebe, Na Zhao