← Back to all news
arXiv Computer Vision By Kartik Bali, Mahish Guru, Yiderigun Borjigin, Alexandra Starostina, Christian J. Cyron, Roland Aydin

Look Where You Can: Active View Selection for CAD Reconstruction under Occlusion

Read the original on arXiv Computer Vision →

The paper introduces SightCAD, a framework for parametric CAD reconstruction that explicitly handles view feasibility constraints in realistic indoor scenes. It learns a view selector to choose a small set of feasible viewpoints for a vision‑language model that generates executable CadQuery code, and jointly trains the selector and the VLM using a reward that depends on the final geometric fidelity. The approach outperforms baseline methods on several benchmarks, achieving higher intersection‑over‑union scores and a lower invalid‑code rate.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Oct 1

Matisse: Evidence-Space Reasoning for Active 3D Reconstruction

Matisse is a training‑free framework that combines active 3D reconstruction with keyframe selection by using evidence from a pretrained generative 3D model. It estimates evidential uncertainty via cross‑attention on 3D latent tokens and derives an evidential information gain to guide view acquisition and keyframe selection, reducing redundant observations and supporting multi‑object scenes with occlusion‑aware aggregation. On GSO30, YCB‑V, and Replica, Matisse improves Chamfer distance by 12.7%, 3.8%, and 9.2% respectively, and speeds up end‑to‑end reconstruction by 1.5× compared to the best baseline.

By Xihang Yu, Kaichen Zhou, Lorenzo Shaikewitz, Cl\'ement Jambon, Xiao Zhan, Rajat Talak, Luca Carlone
More like this →
arXiv Machine Learning
4d ago

CADFather: Autonomous CAD Reconstruction through Coordinated Tool Use

CADFather is an autonomous system that reconstructs editable CAD models from 3D meshes by coordinating vision‑language assistants, learned and algorithmic tools, and numerical optimization. It evaluates and refines candidate CAD programs, maintaining alternatives for each part and preserving the best valid result throughout reconstruction. The system uses pretrained models without additional training and is evaluated on multiple benchmark datasets for reconstruction quality and execution validity.

By Gennadiy Savrasov, Maksim Elistratov, Nikita Gavrilov, Albert Garifullin, Oleg Pavlov, Soslan Kabisov, Vladimir Frolov, Anton Konushin, Andrey Kuznetsov, Dmitrii Zhemchuzhnikov
agentsmultimodal
More like this →
arXiv Computer Vision
Sep 21

VGGT-CAD: Reconstructing Parametric CAD 3D Model with Geometric Grounding

VGGT-CAD is a geometry‑aware framework that reconstructs parametric CAD 3D models from single and multi‑view images. It incorporates pretrained 3D geometric priors by encoding camera parameters as condition tokens and jointly modeling them with image tokens. The method introduces a variable‑view cross‑view context aggregation module and a training‑free geometry‑aware view selection strategy, and decodes the learned representation into CAD command sequences using a non‑autoregressive decoder. Additionally, VideoCAD, a large‑scale multi‑view video benchmark derived from existing CAD data, is presented to evaluate the approach.

By Chunan Yu, Tianrun Chen, Fu Shen, Cheng Chen, Lanyun Zhu, Yang Yang
benchmarks
More like this →