arXiv Computer Vision By Qian Wang, Liam Merz Hoffmeister, Brian Scassellati, Daniel Rakita

I2CD: Direct Image-to-Convex Decomposition for Simulation-Ready Collision Geometry

Read the original on arXiv Computer Vision →

I2CD is a method that directly predicts a convex decomposition of 3D geometry from a single RGB image, bypassing the traditional slow reconstruct‑then‑decompose pipeline. It leverages a frozen pretrained diffusion transformer and shape decoder, adding only a lightweight cross‑attention head to output half‑plane parameters for K convex polytopes. The resulting geometry is compact, convex by construction, and can be loaded into physics engines in about 0.5 s per image, outperforming eight baseline pipelines in speed and volumetric IoU on benchmark datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
5d ago

Look Where You Can: Active View Selection for CAD Reconstruction under Occlusion

The paper introduces SightCAD, a framework for parametric CAD reconstruction that explicitly handles view feasibility constraints in realistic indoor scenes. It learns a view selector to choose a small set of feasible viewpoints for a vision‑language model that generates executable CadQuery code, and jointly trains the selector and the VLM using a reward that depends on the final geometric fidelity. The approach outperforms baseline methods on several benchmarks, achieving higher intersection‑over‑union scores and a lower invalid‑code rate.

By Kartik Bali, Mahish Guru, Yiderigun Borjigin, Alexandra Starostina, Christian J. Cyron, Roland Aydin
arXiv Computer Vision
Oct 2

PixelDense: Dense Prediction as Representation Alignment for Pixel Diffusion

PixelDense introduces a dual‑stream representation alignment for pixel diffusion, separating semantic and geometric teachers (DINOv2, SAM2, Depth Anything v2, Metric3D v2) into distinct projection spaces with an orthogonality penalty. The method improves dense‑prediction benchmarks, boosting PixelGen‑XXL’s GenEval score from 0.7927 to 0.8093, achieving significant gains in panoptic quality and depth accuracy, and accelerating training from random initialization. It also enhances SDEdit editing by preserving background structure and increasing PSNR.

By Lehan Yang, Daiqing Qi, Wenhao Zhang, Avery Li, Yiqing Yang, Yifan Li, Yu Kong, Haitian Zheng, Zhifei Zhang, Zhe Lin, Varun Jampani, Sheng Li
arXiv AI
Sep 7

Where Appearance Fails, Geometry Recognizes: A CAD-Free 3D Shape Prior That Complements Vision Foundation Models

The paper introduces a CAD‑free 3D shape prior that enhances object recognition by reconstructing each object with 3D Gaussian Splatting (3DGS) from short RGB‑D scans and fusing the resulting shape prototype with frozen DINOv2 image features. Experiments on T‑LESS and HOPE datasets show that geometry alone can match or exceed CAD‑based recognition, and that the combined approach improves performance, especially on shape‑distinctive or partially occluded objects. The study demonstrates that the benefit comes from the geometric information rather than rendered pixels, and that the prior is complementary to frozen vision features.

By Chenxi Tao, Seung-Kyum Choi
arXiv Computer Vision
2d ago

Efficient Confidence-Aware Densification for 3DGS

Efficient Confidence-Aware Densification for 3DGS proposes a new densification strategy for 3D Gaussian Splatting that replaces opacity-based sampling with error-driven placement of primitives. The method keeps a fixed primitive budget and places new primitives where image error and low learned confidence are highest, relocating under-contributing primitives accordingly. Across 24 scenes, it outperforms existing fixed-budget methods—including 3DGS-MCMC, ConeGS, and EDGS—in PSNR, SSIM, and LPIPS at budgets from 100k to 2M primitives, and can also leverage prior-based initialization to match or exceed prior methods.

By Manuel Hofer, Thomas K\"ohler, Felix Windisch, Bernhard Kerbl, Markus Steinberger, Lukas Radl