arXiv Computer Vision
HRoPE: Homography Relative Positional Encoding
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Jul 8
RayRoPE: Projective Ray Positional Encoding for Multi-view Attention
arXiv:2601. 15275v3 Announce Type: replace-cross Abstract: We study positional encodings for multi-view transformers that process tokens from a set of posed input images, and seek a mechanism that encodes patches uniquely, allows SE(3)-invariant attention with multi-frequency similarity, and can adapt to the geometry of the underlying 3D scene.
Hugging Face Trending Papers
Sep 14
G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity
We study relative position encoding for multi-view vision Transformers under camera heterogeneity, including varying fields of view (FoVs) or projection models. Existing rotary relative position encod...
arXiv AI
Oct 15
WorldRoPE: Probabilistic World-Centric Rotary Embedding for Multi-View Attention
arXiv:2610.16337v1 Announce Type: cross Abstract: Rotary Positional Embedding (RoPE) is widely used to encode relative positions in Transformers. In multi-view settings, however, patch coordinates ar...
arXiv Computer Vision
Sep 15
G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity
The paper introduces G-ray, a ray-level relative position encoding for multi-view vision Transformers that remains consistent across different camera projections. By parameterizing rotary phases with camera-local ray angles, G-ray achieves projection-invariant positional consistency and can be integrated with existing encodings without extra learned parameters. Experiments on 3D reconstruction and novel-view synthesis benchmarks show that G-ray improves performance, notably reducing mean pointmap relative error by 45.8% over MapAnything.
arXiv Computer Vision
Oct 5
Feedforward Novel View Synthesis for Heterogeneous Cameras
The paper introduces a feed‑forward novel view synthesis method that works across heterogeneous cameras, such as perspective, fisheye, and panoramic types. It addresses tokenization ambiguity by combining token‑center relative Camera Positional Encodings with local raymaps and a projection‑aware 2D RoPE that aligns positional reasoning across different camera projections. Experiments on ScanNet++ show improved performance over camera‑conditioned baselines and zero‑shot generalization to panoramic views.
arXiv AI
Oct 5
OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection
OmniAct3D is a framework that adapts Vision Foundation Model (VFM) detectors trained on perspective images to equirectangular projection (ERP) panoramic images for 3D detection. It introduces the ERP-Ray Geometry Adapter (ERGA-Ray) to model spherical rays, the Visual-Action Reasoning Chain (VARC) to ground hypotheses in panoramic evidence, and the Appearance-Guided Heading Expert (AGHE) to recover high‑resolution heading cues. The method achieves a 2.96 NDS improvement on Spheriverse and a 24.87 mAP gain on PanoMMOcc, while preserving most of the baseline’s performance across configurations.