CALIPER is a model‑free RGB‑D framework that performs fine‑grained recognition of visually similar industrial parts by combining support‑based appearance matching with metric size evidence. Each class is onboarded from a single turntable RGB‑D video and a few labeled real images, enabling 3D reconstruction for appearance support and depth‑aligned size profiling. At inference, a YOLOv8n‑seg model localizes parts, a frozen DINOv2 backbone with an episodically trained embedding head matches support, and margin‑conditioned metric fusion selectively uses size evidence for ambiguous cases, achieving high accuracy on 18 parts and robust enrollment of unseen screws without retraining.
arXiv:2610.34305v1 Announce Type: new Abstract: Object re-identification requires embeddings that are robust to intra-class variation in viewpoint, illumination, and occlusion, yet preserve sharp sep...
RYOPO is an end‑to‑end query‑based RGB‑D set predictor that jointly detects, segments, and estimates 9‑DoF poses of unseen instances within known categories without relying on external instance segmentation or CAD priors. It uses shared image and scene encoding, a query‑conditioned geometry pathway, and object‑centric refinement with pose‑conditioned cross‑attention to achieve accurate pose estimation. On benchmark datasets such as NOCS, REAL275, and HouseCat6D, RYOPO outperforms published methods and runs in real time at 31.8 FPS on an RTX A6000.
ShapeY is a benchmarking framework that evaluates shape-based recognition in object recognition systems using 68,200 grayscale images of 200 3D objects rendered from multiple viewpoints, with optional appearance changes. It employs a nearest‑neighbor matching task to probe how well an embedding space clusters views by 3D shape similarity across varying viewpoints and non‑shape alterations, providing quantitative and qualitative performance readouts such as error rates, viewpoint tuning curves, and matching score histograms. Testing 321 pre‑trained networks shows that even state‑of‑the‑art models struggle to generalize robustly across 3D viewpoint and appearance changes, highlighting gaps in current shape recognition capabilities.
SUFLECA is a weakly supervised framework that improves zero‑shot CAD‑to‑image alignment by scaling geometry‑grounded feature learning using Normalized Object Coordinates across up to 12 real and synthetic datasets. It introduces a geometrically consistent matching algorithm that reliably establishes CAD‑to‑image correspondences, enabling accurate, sub‑second alignment without iterative pose refinement. On the ScanNet25k benchmark, SUFLECA achieves 32.8%/42.6% category/instance accuracy, outperforming the strongest zero‑shot baseline by 9.7/12.5 percentage points and surpassing existing pose‑supervised methods for the first time.
The paper introduces SADGE, a quantitative similarity metric that predicts how well synthetic image datasets will perform on real-world computer vision tasks without requiring downstream model training. SADGE combines appearance and geometric similarity measures through a constrained bilinear interaction, outperforming appearance-only and geometry-only baselines across 79,000 image pairs in five synthetic-to-real benchmark families. The study demonstrates that the non‑linear interplay between appearance and geometry, rather than either alone, best predicts downstream performance in tasks such as object detection, semantic segmentation, and pose estimation.
The paper introduces a CAD‑free 3D shape prior that enhances object recognition by reconstructing each object with 3D Gaussian Splatting (3DGS) from short RGB‑D scans and fusing the resulting shape prototype with frozen DINOv2 image features. Experiments on T‑LESS and HOPE datasets show that geometry alone can match or exceed CAD‑based recognition, and that the combined approach improves performance, especially on shape‑distinctive or partially occluded objects. The study demonstrates that the benefit comes from the geometric information rather than rendered pixels, and that the prior is complementary to frozen vision features.
SemGeo-Gen is an unsupervised approach that generates approximate cross‑instance semantic‑geometric correspondences from weakly aligned 3D object collections. It uses coarse category‑level rotation alignment, lifts multi‑view DINOv2 features to 3D, applies continuous piecewise‑affine registration, and prunes matches with semantic consistency to produce 3D correspondences that can be projected into 2D views for scalable supervision. The method achieves high accuracy against human annotations and improves state‑of‑the‑art semantic correspondence models after synthetic pretraining.
arXiv:2607. 05568v1 Announce Type: cross Abstract: Representing 3D shapes as compact sets of geometric primitives is fundamental to robotics, simulation, and scene understanding.
F2G-Pose is a real‑time, single‑pass framework for category‑level RGB‑D object pose estimation that predicts 3D rotation, translation, metric size, and a completed camera‑frame shape from a single RGB‑D observation. It lifts dense visual foundation features to partial point clouds, encodes local geometry with DGCNN tokenization, and uses a Mixture‑of‑Experts Transformer to integrate object‑level structure. Trained only on pose‑annotated synthetic SOPE data and leveraging a frozen RADIO backbone, F2G‑Pose achieves state‑of‑the‑art accuracy on SOPE and ROPE while running at 28 FPS for pose‑only inference and demonstrates strong geometry completion on HouseCat6D and real‑object transfer on HANDAL.
F2G-Pose is a real‑time, single‑pass framework for category‑level RGB‑D object pose estimation that predicts pose, metric size, and camera‑frame completed shape from a single RGB‑D observation. It lifts dense visual foundation features to partial point clouds, encodes local geometry with DGCNN tokenization, and uses a Mixture‑of‑Experts Transformer to integrate object‑level structure. Trained only on pose‑annotated synthetic SOPE data with a frozen RADIO backbone, it achieves state‑of‑the‑art accuracy on SOPE and ROPE while running at 28 FPS for pose‑only inference and demonstrates strong geometry on HouseCat6D and real‑object transfer on HANDAL.
Geometry-Aligned Semantic Matching for Cross-Modal Planar Image Registration proposes CDPM, a method that first aligns semantic representations across modalities and then refines correspondences with fine-grained CNN features. CDPM adapts DINOv3 using geometrically consistent cross-modal patch pairs, builds a DINO-Centric Feature Pyramid for stable cross-modal matching, and adds a lightweight CNN branch for precise local refinement. Experiments on three cross-modal datasets show that CDPM outperforms existing dense matchers, improving AUC metrics and reducing mACE while using fewer FLOPs.
arXiv:2606.16569v2 Announce Type: replace Abstract: Registering two captures of the same indoor space taken at different times underpins persistent spatial memory for robots and AR systems, yet the r...