arXiv Computer Vision

RoMa-$\Omega$: What Feed-Forward 3D Models Know About Image Matching

arXiv Computer Vision
6d ago

VGGT-$\Omega$

arXiv:2605.15195v2 Announce Type: replace Abstract: Recent feed-forward reconstruction models, such as VGGT, have proven competitive with traditional optimization-based reconstructors while also prov...

By Jianyuan Wang, Minghao Chen, Shangzhan Zhang, Nikita Karaev, Johannes Sch\"onberger, Patrick Labatut, Piotr Bojanowski, David Novotny, Andrea Vedaldi, Christian Rupprecht
Hugging Face Trending Papers
Jul 20

MuViSeg: Multi-View Segment Correspondences from Dense Geometry Priors

Classical image correspondence is solved at the level of sparse keypoints or dense pixels, but the systems that consume these matches - object-level mapping, topological navigation, scene-graph maintenance - reason about whole objects. Recent work narrows this gap by matchng directly at the level of instance segments: a class-agnostic segmenter partitions each image, and per-segment descriptors are obtained by pooling features from large 3D foundation models over the masks.

arXiv Computer Vision
Oct 5

Geometry-Aligned Semantic Matching for Cross-Modal Planar Image Registration

Geometry-Aligned Semantic Matching for Cross-Modal Planar Image Registration proposes CDPM, a method that first aligns semantic representations across modalities and then refines correspondences with fine-grained CNN features. CDPM adapts DINOv3 using geometrically consistent cross-modal patch pairs, builds a DINO-Centric Feature Pyramid for stable cross-modal matching, and adds a lightweight CNN branch for precise local refinement. Experiments on three cross-modal datasets show that CDPM outperforms existing dense matchers, improving AUC metrics and reducing mACE while using fewer FLOPs.

By Zhiwei Wang, Defeng He, Yuxing Li, Meilu Zhu, Edmund Y. Lam
arXiv AI
Oct 26

SemGeo-Gen: Unsupervised Generation of Approximate Cross-Instance Semantic-Geometric Correspondences

SemGeo-Gen is an unsupervised approach that generates approximate cross‑instance semantic‑geometric correspondences from weakly aligned 3D object collections. It uses coarse category‑level rotation alignment, lifts multi‑view DINOv2 features to 3D, applies continuous piecewise‑affine registration, and prunes matches with semantic consistency to produce 3D correspondences that can be projected into 2D views for scalable supervision. The method achieves high accuracy against human annotations and improves state‑of‑the‑art semantic correspondence models after synthetic pretraining.

By Roy Amoyal, Shira Ifergane, Oren Freifeld
arXiv Computer Vision
Oct 16

Auditing Metrics for Synthetic Data Utility: A Cross-Domain Study of Appearance and Geometry

The paper introduces SADGE, a quantitative similarity metric that predicts how well synthetic image datasets will perform on real-world computer vision tasks without requiring downstream model training. SADGE combines appearance and geometric similarity measures through a constrained bilinear interaction, outperforming appearance-only and geometry-only baselines across 79,000 image pairs in five synthetic-to-real benchmark families. The study demonstrates that the non‑linear interplay between appearance and geometry, rather than either alone, best predicts downstream performance in tasks such as object detection, semantic segmentation, and pose estimation.

By Patryk Bartkowiak, Dominik Michels, Soren Pirk, Wojtek Palubicki
arXiv Machine Learning
Aug 7

SR-JEPA: Learning Predictive Latent State in 3D Scenes

arXiv:2608. 05774v1 Announce Type: cross Abstract: Joint-embedding predictive architectures learn by predicting latent representations of missing observations, yet many masked JEPAs are evaluated primarily through the encoders they produce.

By Zihan Zhou, Qifu Wen, Xi Zeng
arXiv Computer Vision
Sep 25

One View Is Enough: In-the-Wild Monocular Pretraining for Novel View Generation

The paper introduces OVIE, a monocular novel-view synthesis method that eliminates the need for multi‑view training data. By using a frozen depth estimator to generate pseudo‑target views from single images and applying masked and adversarial losses, OVIE is trained on 30 million uncurated images. It achieves state‑of‑the‑art performance on RealEstate10K and DL3DV, produces highly consistent multi‑view trajectories, and runs at 116 FPS—over 600× faster than the fastest baseline.

By Adrien Ramanana Rahary, Nicolas Dufour, Patrick Perez, David Picard
arXiv Machine Learning
Oct 12

Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction

Zebra3D introduces a layerwise sparse‑linear hybrid attention framework that enhances the efficiency of pretrained 3D foundation models without requiring training from scratch. By assigning linear‑centered attention to tolerant early stages and tile‑sparse attention to sensitive middle‑to‑late stages, it preserves context through landmark summaries and enables training‑free conversion via closed‑form affine fitting. Across multiple backbones, Zebra3D achieves strong reconstruction and camera‑pose accuracy with high attention sparsity, delivering up to 7.1× speedups at 1,024 views and maintaining performance close to dense counterparts after optional post‑conversion training.

By Utkarsh Saxena, Ruijing Yang, Mehdi Rezagholizadeh, Akash Haridas, Vikram Appia, Emad Barsoum