arXiv Computer Vision

Blueprint2CAD: Benchmarking Foundation Models on Engineering Drawing-to-CAD Render Correspondence

arXiv Computer Vision
Oct 9

Look Where You Can: Active View Selection for CAD Reconstruction under Occlusion

The paper introduces SightCAD, a framework for parametric CAD reconstruction that explicitly handles view feasibility constraints in realistic indoor scenes. It learns a view selector to choose a small set of feasible viewpoints for a vision‑language model that generates executable CadQuery code, and jointly trains the selector and the VLM using a reward that depends on the final geometric fidelity. The approach outperforms baseline methods on several benchmarks, achieving higher intersection‑over‑union scores and a lower invalid‑code rate.

By Kartik Bali, Mahish Guru, Yiderigun Borjigin, Alexandra Starostina, Christian J. Cyron, Roland Aydin
arXiv Computation and Language
Sep 4

RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intents

RealCADBench is a new benchmark for evaluating intent‑to‑program parametric CAD modeling, featuring 12,632 tasks drawn from 19 factory‑automation categories and covering text, 2D drawings, product photos, and rendered images for both Part and Assembly modeling. The study reports results on a 1,770‑task evaluation slice, using metrics such as executability, Solid IoU, Surface IoU, and a rubric‑based visual‑semantic identity Judge. Across nine standalone and six frontier‑scale large models, no single model dominates all four metrics, highlighting diverse strengths and failure modes like missing fine structures and incorrect assembly placement.

By JoyIndustrial VisCAD Team, Linxin Cai, Qiuhe Hong, Zhichao Huang, Guanlin Li, Zongzhen Li, Hongsen Liu, Yichen Long, Wei Wang, Yuchen Wang, Dongyue Yang, Huimu Yu, Xianwen Zhong
arXiv Machine Learning
Oct 12

Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation

Vision2Code is a new benchmark for image-to-code generation that covers 15 domains and 539 test examples without relying on reference source code. It evaluates generated programs by executing them and comparing rendered outputs to the original images using domain‑specific rubrics, yielding scores that correlate better with human judgments than generic metrics. The study shows domain variability in model performance and demonstrates that the scoring method can improve fine‑tuning of models like Qwen3.5‑9B and Phi‑4‑MM via rejection sampling.

By Ajay Vikram Periasami, Junlin Wang, Bhuwan Dhingra
arXiv AI
Sep 7

Where Appearance Fails, Geometry Recognizes: A CAD-Free 3D Shape Prior That Complements Vision Foundation Models

The paper introduces a CAD‑free 3D shape prior that enhances object recognition by reconstructing each object with 3D Gaussian Splatting (3DGS) from short RGB‑D scans and fusing the resulting shape prototype with frozen DINOv2 image features. Experiments on T‑LESS and HOPE datasets show that geometry alone can match or exceed CAD‑based recognition, and that the combined approach improves performance, especially on shape‑distinctive or partially occluded objects. The study demonstrates that the benefit comes from the geometric information rather than rendered pixels, and that the prior is complementary to frozen vision features.

By Chenxi Tao, Seung-Kyum Choi