arXiv Computer Vision By Jong Woo Nam, Amanda S. Rios, Bartlett W. Mel

ShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matching

Read the original on arXiv Computer Vision →

ShapeY is a benchmarking framework that evaluates shape-based recognition in object recognition systems using 68,200 grayscale images of 200 3D objects rendered from multiple viewpoints, with optional appearance changes. It employs a nearest‑neighbor matching task to probe how well an embedding space clusters views by 3D shape similarity across varying viewpoints and non‑shape alterations, providing quantitative and qualitative performance readouts such as error rates, viewpoint tuning curves, and matching score histograms. Testing 321 pre‑trained networks shows that even state‑of‑the‑art models struggle to generalize robustly across 3D viewpoint and appearance changes, highlighting gaps in current shape recognition capabilities.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 4

TokenMatch: 3D Mesh Correspondence Transformer with Curvature-Guided Tokenisation

TokenMatch is a transformer-based model that estimates 3D shape correspondences by adaptively tokenising meshes into curvature-guided patches. Trained only on the BeCoS partial-to-partial dataset, it generalises to full-shape matching without retraining, using self‑ and cross‑attention to learn patch‑ and point‑level relations. Evaluated on CP2P, PSMAL, BeCoS, FAUST, SCAPE, and SHREC'19, TokenMatch consistently outperforms existing methods in mean geodesic error and intersection‑over‑union while achieving sub‑second inference speeds.

By Adeela Islam, Zorah L\"ahner, Vittorio Murino, Vladislav Golyanik
arXiv Computer Vision
3d ago

Auditing Metrics for Synthetic Data Utility: A Cross-Domain Study of Appearance and Geometry

The paper introduces SADGE, a quantitative similarity metric that predicts how well synthetic image datasets will perform on real-world computer vision tasks without requiring downstream model training. SADGE combines appearance and geometric similarity measures through a constrained bilinear interaction, outperforming appearance-only and geometry-only baselines across 79,000 image pairs in five synthetic-to-real benchmark families. The study demonstrates that the non‑linear interplay between appearance and geometry, rather than either alone, best predicts downstream performance in tasks such as object detection, semantic segmentation, and pose estimation.

By Patryk Bartkowiak, Dominik Michels, Soren Pirk, Wojtek Palubicki
arXiv Computer Vision
Sep 17

CALIPER: Metric-Grounded Model-Free Recognition of Visually Similar Industrial Parts

CALIPER is a model‑free RGB‑D framework that performs fine‑grained recognition of visually similar industrial parts by combining support‑based appearance matching with metric size evidence. Each class is onboarded from a single turntable RGB‑D video and a few labeled real images, enabling 3D reconstruction for appearance support and depth‑aligned size profiling. At inference, a YOLOv8n‑seg model localizes parts, a frozen DINOv2 backbone with an episodically trained embedding head matches support, and margin‑conditioned metric fusion selectively uses size evidence for ambiguous cases, achieving high accuracy on 18 parts and robust enrollment of unseen screws without retraining.

By Alankrit Gupta, Chenxi Tao, Seung-Kyum Choi
arXiv AI
Oct 2

Modeling The Object Representations Underlying Human Physical Reasoning

The study investigates how vision models represent objects compared to humans during physical reasoning tasks. By comparing segmentation outputs from several architectures (DINOv2, SegFormer, DeepLabV3+, UPerNet) to human behavior in time‑to‑collision and change‑detection tasks, the authors find that briefly trained models are too coarse, fully trained models are too fine, and an intermediate training stage best matches the coarse, volumetric bodies humans use. Larger models reach this intermediate alignment earlier, suggesting that resource constraints drive the emergence of human‑like representations in general‑purpose vision systems.

By Andrey Gizdov, Andrea Procopio, Lorenzo Caputi, Georgi I. Ivanov, Yichen Li, Daniel Harari, Tomer Ullman