arXiv Computer Vision

ROSETTA: Rotation Subspace Estimation for Training-free Transmodal Alignment

ROSETTA is a training‑free calibration layer that aligns feature spaces from independently trained encoders by estimating a local rotation in whitened space. It relies on the observation that the relative transformation between any two such systems is a spatially preserving rotation whose angular velocity behaves like white noise, and that the cross‑covariance between encoder outputs has low effective rank, making local alignment tractable. The method uses an expectation‑maximization procedure and requires no co‑observation at query time, achieving milliseconds overhead per query on three public driving datasets across LiDAR, camera, thermal, and event modalities.

Hugging Face Trending Papers
Jun 23

REDI-Match: Rotation-Equivariant Distillation for Efficient and Robust Dense Matching

Vision Foundation Models (VFMs) have significantly advanced dense feature matching, yet severe in-plane rotation remains a critical challenge. Existing solutions face a fundamental dilemma: data-driven methods require inefficient parameter scaling to implicitly learn rotations, whereas strictly equivariant networks lack the semantic capacity of modern VFMs.

arXiv Machine Learning
Sep 23

GINIO: A Geometric SO(3)-Equivariant Interface for Neural Inertial Odometry

GINIO is a geometric SO(3)-equivariant interface designed for neural inertial odometry that ensures learned measurements transform consistently under any IMU mounting convention. It predicts motion measurements and uncertainties that obey vector and tensor transformation laws, and introduces Last-Frame Alignment to enable efficient sensor-frame learning equivalent to world-frame training. The interface is instantiated in several architectures—filter-connected NIO, AirIO-style recurrent aerial prediction, EqNIO-style full-SO(3) canonicalization, and ResNet-style temporal backbones—achieving significant accuracy and efficiency gains across multiple benchmarks.

By Chankyo Kim, Minghan Zhu, Tzu-Yuan Lin, Avantika Rattan, Maani Ghaffari
arXiv Computer Vision
Oct 2

PAGER: Partial-to-global Alignment via Geometric and Relational Distillation

PAGER is a label‑free adaptation method that aligns partial, viewpoint‑dependent 3D observations with a frozen global semantic space. It uses matched‑point feature alignment and relational supervision to anchor partial features to their global counterparts while preserving similarity structure, all without altering the pretrained encoder or global probe. Experiments show PAGER outperforms label‑supervised PEFT on Sonata and Concerto, and achieves superior zero‑shot transfer from ScanNet to ScanNet++ compared to fully fine‑tuned Sonata.

By Akira-Miranda Adeyomi Adeniran-Lowe, Binod Singh, Lars Arnold Dethlefsen, Lazaros Nalpantidis, Theodora Kontogianni
arXiv AI
Oct 1

Template-Search Domain Adaptation via Multi-Stage Feature Alignment for Cross-Modal Object Tracking

The paper introduces TSDA-Track, a Template-Search Domain Adaptation framework designed to reduce modality gaps in cross‑modal visual object tracking. Two variants are explored: Pre‑AFA TSDA‑Track uses adversarial alignment before transformer interaction, while Enc‑CFA TSDA‑Track applies contrastive alignment after interaction to strengthen cross‑modal correspondence. Experiments on datasets such as LasHeR, RGBT234, GTOT, and Anti‑UAV‑024 show that both variants outperform state‑of‑the‑art trackers, with Pre‑AFA achieving an SR/PR of 43.2/56.0 on RGBT234 under the modality‑switch protocol.

By Fereshteh Aghaee Meibodi, Amir Mehdi Soufi Enayati, Shadi Alijani, Homayoun Najjaran
arXiv Computer Vision
Sep 21

Refining Ground Truth Poses in Autonomous Driving Datasets via Neural Rendering

arXiv:2504.15776v2 Announce Type: replace Abstract: Public autonomous driving datasets underpin the training and benchmarking of perception, mapping, and localization algorithms, yet residual inaccur...

By Quentin Herau, Nathan Piasco, Moussab Bennehar, Luis Rold\~ao, Dzmitry Tsishkou, Bingbing Liu, Cyrille Migniot, Pascal Vasseur, C\'edric Demonceaux
arXiv Machine Learning
Oct 16

RoLaQ: Joint Rotation and Range Calibration for 2-Bit KV Caches in Multi-Head Latent Attention

RoLaQ is an offline technique that jointly calibrates rotation and quantization range for 2‑bit key‑value caches in multi‑head latent attention models. By refining a shared rotation within subspaces defined by frozen key and value projections and learning coupled quantization thresholds and reconstruction gains, RoLaQ improves prediction matching and attention‑output supervision while keeping model weights frozen. Experiments on three MLA models and six benchmarks show that RoLaQ outperforms other 2‑bit methods, achieving higher average accuracy and, in a DeepSeek‑V2‑Lite implementation, nearly four times the BF16 KV capacity and more than double the decode throughput for 256K input tokens.

By Shiyu Ji, Peng Ling, Chen Lin, Shupeng Li, Yixuan Wang, Qingfu Zhu, Wanxiang Che
arXiv Computer Vision
Sep 23

Vision Foundation Models with Synthetic-Only Training for Monocular Spacecraft Pose Estimation

The paper presents a new monocular spacecraft pose estimation model that achieves the lowest reported mean rotation errors on the SPEED+ lightbox and sunlamp test sets. By replacing smaller encoders with a large self‑supervised ViT foundation model (DINOv3) and scaling up to 840 M parameters, the authors improve accuracy from 300 M to 840 M parameters without saturation. The 840 M model also runs on a Jetson Orin NX 16 GB with 133.8 ms per crop and 32.0 W power draw, demonstrating embedded inference feasibility while training solely on synthetic data.

By John Church, Vazghen Nikolian
arXiv Computer Vision
Oct 27

Tight Learned Event-Inertial Odometry (TLEIO): a Transformer-Based Architecture for End-to-End Motion from Event Streams

arXiv:2610.33356v1 Announce Type: new Abstract: Event cameras provide microsecond temporal resolution, high dynamic range, and sparse asynchronous measurements, making them compelling for odometry un...

By Matteo Cascone, David Jensen, Alessandro Pirini, Angelo Stefanini, Pietro Ven\`e, Marta Tintor\'e Gazulla, Javier Hidalgo Carri\`o