arXiv Computer Vision

MaPa: Text-driven Photorealistic Material Painting for 3D Shapes

arXiv Computer Vision
Sep 4

PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models

PoseDreamer is a new pipeline that uses diffusion models to generate large‑scale synthetic datasets for 3D human mesh estimation, providing 3D mesh annotations that remain aligned with the generated images. The system incorporates controllable image generation, Direct Preference Optimization for control alignment, curriculum‑based hard sample mining, and multi‑stage quality filtering to produce over 500,000 high‑quality samples with a 76% improvement in image‑quality metrics over traditional rendering‑based datasets. Models trained on PoseDreamer match or surpass those trained on real‑world or conventional synthetic data, and combining PoseDreamer with synthetic datasets yields better performance than mixing real and synthetic data alone.

By Lorenza Prospero, Orest Kupyn, Ostap Viniavskyi, Jo\~ao F. Henriques, Christian Rupprecht
arXiv AI
Jul 28

DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces

arXiv:2603. 05607v2 Announce Type: replace-cross Abstract: Computer-Aided Design (CAD) relies on structured and editable geometric representations, yet existing generative methods are constrained by small annotated datasets with explicit design histories or boundary representation (BRep) labels.

By Mohammad Sadil Khan, Muhammad Usama, Rolandos Alexandros Potamias, Didier Stricker, Muhammad Zeshan Afzal, Jiankang Deng, Ismail Elezi
arXiv Computer Vision
Sep 25

OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization

OREO is a framework that improves the visual fidelity of 3D generation models by using on-the-fly rendered and edited 2D views as pseudo-targets. It introduces a dynamic optimization loop where a 2D diffusion model refines rendered views, preserving geometry, viewpoint, and content while enhancing realism. These refined views serve as high‑quality supervision, enabling the 3D generator to learn from its own outputs and progressively improve its visual quality, outperforming pre‑trained baselines.

By Zhiyuan Ma, Wenbo Hu, Wang Zhao, Pengfei Wang, Ying Shan, Lei Zhang
arXiv Computer Vision
Sep 1

Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models

The paper introduces Chat-Edit-3D++ (CE3D++), an interactive 3D and 4D scene editing system that uses a Hash-Atlas network to separate 2D editing from 3D reconstruction. CE3D++ employs a large language model to accept arbitrary textual input, interpret user intent, and autonomously invoke appropriate visual models, enabling multi‑round dialogue and diverse editing effects. The approach is extended to monocular 4D scenes by adding motion constraints and a trajectory dataset, allowing a smaller LLM to schedule up to 30 visual tools accurately.

By Shuangkang Fang, Yufeng Wang, Yi-Hsuan Tsai, Wenrui Ding, Yi Yang, Shuchang Zhou, Ming-Hsuan Yang
arXiv Machine Learning
Sep 2

CADKnitter: Compositional CAD Generation from Text and Geometry Guidance

CADKnitter is a compositional CAD generation framework that uses geometric-guiding cues to steer diffusion sampling, enabling the creation of complementary CAD parts that satisfy both geometric constraints of an existing model and semantic constraints from a text prompt. The authors introduce KnitCAD, a dataset of over 310,000 CAD models paired with textual prompts and assembly metadata to support training and evaluation. Experiments show that CADKnitter outperforms state‑of‑the‑art baselines by a clear margin.

By Tri Le, Khang Nguyen, Baoru Huang, Tung D. Ta, Anh Nguyen