arXiv Computer Vision By Adam Bethell, Ravi Garg, Ian Reid

Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion

Read the original on arXiv Computer Vision →

The paper presents a generative framework that estimates category-level 6D pose and 3D size of objects from a single RGB image, using score-based diffusion models to produce a multi-hypothesis pose distribution. It replaces costly likelihood pruning with a Mean Shift approach to isolate the mode as the final pose estimate, achieving state-of-the-art results on the REAL275 benchmark. The method also decouples detection from pose estimation, enabling robust zero-shot generalisation on the Wild6D dataset and extending naturally to video sequences by propagating the pose distribution over time.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 22

SDPose: Exploiting Diffusion Priors for Out-of-Domain and Robust Pose Estimation

SDPose leverages pre‑trained diffusion models, specifically the Stable Diffusion U‑Net, to extract robust latent features for human pose estimation. By identifying the most effective upsampling levels, fusing these features with a lightweight aggregation module, and jointly training with keypoint heatmap supervision and a latent reconstruction loss, SDPose achieves strong cross‑domain generalization. The authors introduce the COCO‑OOD benchmark, comprising style‑transferred and corrupted subsets, to evaluate robustness, and demonstrate that SDPose matches Sapiens on COCO while outperforming competitors in zero‑shot cross‑domain scenarios.

By Shuang Liang, Jing He, Lejun Liao, Chuanmeizhi Wang, Guo Zhang, Yingcong Chen, Yuan Yuan
arXiv Computer Vision
Oct 9

Accurate and Efficient Object Pose Estimation via the Aggregation of Diffusion Features

The paper introduces a new approach to 3D object pose estimation that leverages diffusion model features, such as those from Stable Diffusion, to improve performance on unseen objects. Three aggregation architectures—vanilla, nonlinear, and context‑aware—are proposed, with a confidence‑adaptive aggregation network that selectively uses discriminative features to balance speed and accuracy. The method achieves state‑of‑the‑art accuracy on unseen object benchmarks (97.7% vs. 93.5% on Unseen LM) and real‑time performance (68 FPS) while reducing computational cost.

By Tianfu Wang, Guosheng Hu, Hongguang Wang
arXiv Computer Vision
Oct 5

RYOPO: Bringing End-to-End Category-Level Object Pose Estimation into Real Time

RYOPO is an end‑to‑end query‑based RGB‑D set predictor that jointly detects, segments, and estimates 9‑DoF poses of unseen instances within known categories without relying on external instance segmentation or CAD priors. It uses shared image and scene encoding, a query‑conditioned geometry pathway, and object‑centric refinement with pose‑conditioned cross‑attention to achieve accurate pose estimation. On benchmark datasets such as NOCS, REAL275, and HouseCat6D, RYOPO outperforms published methods and runs in real time at 31.8 FPS on an RTX A6000.

By Hakjin Lee, Junghoon Seo, Jaehoon Sim
arXiv Computer Vision
Oct 9

PointVGGT: Zero-Shot Multiview RGB-D Point Cloud Registration with Visual Geometry Foundation Priors

The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that replaces the traditional pairwise‑then‑global pipeline. It employs a foundation‑then‑refinement paradigm, using visual geometry foundation models to directly recover metrically consistent global poses and then refining them with voxelized spatial hashing and IRLS‑based bundle adjustment. Experiments on indoor, object‑centric, and outdoor datasets demonstrate superior registration accuracy and computational efficiency without any training.

By Haobo Jiang, Liang Yu, Jianmin Zheng