arXiv Computer Vision By Tianfu Wang, Guosheng Hu, Hongguang Wang

Accurate and Efficient Object Pose Estimation via the Aggregation of Diffusion Features

Read the original on arXiv Computer Vision →

The paper introduces a new approach to 3D object pose estimation that leverages diffusion model features, such as those from Stable Diffusion, to improve performance on unseen objects. Three aggregation architectures—vanilla, nonlinear, and context‑aware—are proposed, with a confidence‑adaptive aggregation network that selectively uses discriminative features to balance speed and accuracy. The method achieves state‑of‑the‑art accuracy on unseen object benchmarks (97.7% vs. 93.5% on Unseen LM) and real‑time performance (68 FPS) while reducing computational cost.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 22

SDPose: Exploiting Diffusion Priors for Out-of-Domain and Robust Pose Estimation

SDPose leverages pre‑trained diffusion models, specifically the Stable Diffusion U‑Net, to extract robust latent features for human pose estimation. By identifying the most effective upsampling levels, fusing these features with a lightweight aggregation module, and jointly training with keypoint heatmap supervision and a latent reconstruction loss, SDPose achieves strong cross‑domain generalization. The authors introduce the COCO‑OOD benchmark, comprising style‑transferred and corrupted subsets, to evaluate robustness, and demonstrate that SDPose matches Sapiens on COCO while outperforming competitors in zero‑shot cross‑domain scenarios.

By Shuang Liang, Jing He, Lejun Liao, Chuanmeizhi Wang, Guo Zhang, Yingcong Chen, Yuan Yuan
arXiv Computer Vision
Sep 17

Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion

The paper presents a generative framework that estimates category-level 6D pose and 3D size of objects from a single RGB image, using score-based diffusion models to produce a multi-hypothesis pose distribution. It replaces costly likelihood pruning with a Mean Shift approach to isolate the mode as the final pose estimate, achieving state-of-the-art results on the REAL275 benchmark. The method also decouples detection from pose estimation, enabling robust zero-shot generalisation on the Wild6D dataset and extending naturally to video sequences by propagating the pose distribution over time.

By Adam Bethell, Ravi Garg, Ian Reid
arXiv Computer Vision
Oct 5

RYOPO: Bringing End-to-End Category-Level Object Pose Estimation into Real Time

RYOPO is an end‑to‑end query‑based RGB‑D set predictor that jointly detects, segments, and estimates 9‑DoF poses of unseen instances within known categories without relying on external instance segmentation or CAD priors. It uses shared image and scene encoding, a query‑conditioned geometry pathway, and object‑centric refinement with pose‑conditioned cross‑attention to achieve accurate pose estimation. On benchmark datasets such as NOCS, REAL275, and HouseCat6D, RYOPO outperforms published methods and runs in real time at 31.8 FPS on an RTX A6000.

By Hakjin Lee, Junghoon Seo, Jaehoon Sim
arXiv AI
Jul 7

MemPose: Category-level Object Pose Estimation with Memory

arXiv:2607. 04930v1 Announce Type: cross Abstract: In the pursuit of robust and generalizable category-level object pose estimation, most existing methods adopt parametric formulations that learn effective representations from data, yet they primarily encode category-level patterns into fixed shape priors or static parameter weights, which limits their scalability to highly diverse instances.

By Xiao Lin, Minghao Zhu, Yun Peng, Liuyi Wang, Qiyi Wang, Chengju Liu, Qijun Chen
Hugging Face Trending Papers
Jul 6

MemPose: Category-level Object Pose Estimation with Memory

In the pursuit of robust and generalizable category-level object pose estimation, most existing methods adopt parametric formulations that learn effective representations from data, yet they primarily encode category-level patterns into fixed shape priors or static parameter weights, which limits their scalability to highly diverse instances. In this paper, we rethink category-level pose estimation from a memory-centric perspective and present MemPose, a memory-augmented framework that explicitly incorporates category-level geometric memory into the pose estimation pipeline.