arXiv Computer Vision

RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias

arXiv AI
Jul 28

DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces

arXiv:2603. 05607v2 Announce Type: replace-cross Abstract: Computer-Aided Design (CAD) relies on structured and editable geometric representations, yet existing generative methods are constrained by small annotated datasets with explicit design histories or boundary representation (BRep) labels.

By Mohammad Sadil Khan, Muhammad Usama, Rolandos Alexandros Potamias, Didier Stricker, Muhammad Zeshan Afzal, Jiankang Deng, Ismail Elezi
arXiv Computer Vision
Sep 21

VGGT-CAD: Reconstructing Parametric CAD 3D Model with Geometric Grounding

VGGT-CAD is a geometry‑aware framework that reconstructs parametric CAD 3D models from single and multi‑view images. It incorporates pretrained 3D geometric priors by encoding camera parameters as condition tokens and jointly modeling them with image tokens. The method introduces a variable‑view cross‑view context aggregation module and a training‑free geometry‑aware view selection strategy, and decodes the learned representation into CAD command sequences using a non‑autoregressive decoder. Additionally, VideoCAD, a large‑scale multi‑view video benchmark derived from existing CAD data, is presented to evaluate the approach.

By Chunan Yu, Tianrun Chen, Fu Shen, Cheng Chen, Lanyun Zhu, Yang Yang
arXiv Machine Learning
Jun 3

CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimization

arXiv:2605. 01171v2 Announce Type: replace-cross Abstract: Despite recent progress, recovering parametric CAD construction sequences from geometric input, such as meshes or point clouds, is a key challenge for design and manufacturing, as existing CAD reconstruction and generation methods are largely restricted to difficult-to-edit formats like meshes or Breps or editable simple sketch-and-extrude pipelines and low-complexity datasets.

By Ghadi Nehme, Eamon Whalen, Faez Ahmed
arXiv Computer Vision
Sep 17

CADSplat: Sparse-View 3D Gaussian Splatting Aided by CAD Models for Robust, Photorealistic Digital-Twin Reconstruction

CADSplat is a framework that reconstructs photorealistic, geometrically accurate digital twins from fewer than 15 wide‑baseline images by regularizing 3D Gaussian Splatting with an explicit CAD shape prior. It matches segmented object silhouettes to a CAD library to retrieve a suitable model and camera poses, then anchors Gaussian primitives to the model’s surface and jointly optimizes splat parameters, registration, and a non‑rigid deformation field. Experiments on two real‑world datasets show CADSplat outperforms baselines, especially in sparse and self‑occluded scenarios, and its gains mainly stem from constraining splats to a surface rather than the CAD shape itself.

By Kristof Overdulve, Lode Jorissen, Nick Michiels
arXiv Computer Vision
Oct 8

CADReasoner: Iterative Program Editing for CAD Reverse Engineering

CADReasoner is a model that iteratively refines its CAD reconstruction by comparing the input shape with the predicted mesh, outputting a runnable CadQuery Python program. It fuses multi‑view renders and point clouds and uses a scan‑simulation protocol to bridge realism gaps during training and evaluation. The approach achieves state‑of‑the‑art performance on DeepCAD, Fusion 360, and MCB benchmarks for both clean and scan‑sim tracks.

By Soslan Kabisov, Vsevolod Kirichuk, Andrey Volkov, Gennadii Savrasov, Marina Barannikov, Anton Konushin, Andrey Kuznetsov, Dmitrii Zhemchuzhnikov
arXiv Computer Vision
Oct 9

Look Where You Can: Active View Selection for CAD Reconstruction under Occlusion

The paper introduces SightCAD, a framework for parametric CAD reconstruction that explicitly handles view feasibility constraints in realistic indoor scenes. It learns a view selector to choose a small set of feasible viewpoints for a vision‑language model that generates executable CadQuery code, and jointly trains the selector and the VLM using a reward that depends on the final geometric fidelity. The approach outperforms baseline methods on several benchmarks, achieving higher intersection‑over‑union scores and a lower invalid‑code rate.

By Kartik Bali, Mahish Guru, Yiderigun Borjigin, Alexandra Starostina, Christian J. Cyron, Roland Aydin
arXiv AI
Oct 15

Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective

arXiv:2604.14025v2 Announce Type: replace-cross Abstract: Reconstructing 3D representations from 2D inputs is a fundamental task in computer vision and graphics, serving as a cornerstone for understa...

By Weijie Wang, Qihang Cao, Sensen Gao, Donny Y. Chen, Haofei Xu, Wenjing Bian, Songyou Peng, Tat-Jen Cham, Chuanxia Zheng, Andreas Geiger, Jianfei Cai, Jia-Wang Bian, Bohan Zhuang