arXiv Computer Vision

SDPose: Exploiting Diffusion Priors for Out-of-Domain and Robust Pose Estimation

SDPose leverages pre‑trained diffusion models, specifically the Stable Diffusion U‑Net, to extract robust latent features for human pose estimation. By identifying the most effective upsampling levels, fusing these features with a lightweight aggregation module, and jointly training with keypoint heatmap supervision and a latent reconstruction loss, SDPose achieves strong cross‑domain generalization. The authors introduce the COCO‑OOD benchmark, comprising style‑transferred and corrupted subsets, to evaluate robustness, and demonstrate that SDPose matches Sapiens on COCO while outperforming competitors in zero‑shot cross‑domain scenarios.

arXiv Computer Vision
Oct 9

Accurate and Efficient Object Pose Estimation via the Aggregation of Diffusion Features

The paper introduces a new approach to 3D object pose estimation that leverages diffusion model features, such as those from Stable Diffusion, to improve performance on unseen objects. Three aggregation architectures—vanilla, nonlinear, and context‑aware—are proposed, with a confidence‑adaptive aggregation network that selectively uses discriminative features to balance speed and accuracy. The method achieves state‑of‑the‑art accuracy on unseen object benchmarks (97.7% vs. 93.5% on Unseen LM) and real‑time performance (68 FPS) while reducing computational cost.

By Tianfu Wang, Guosheng Hu, Hongguang Wang
arXiv Computer Vision
Sep 17

Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion

The paper presents a generative framework that estimates category-level 6D pose and 3D size of objects from a single RGB image, using score-based diffusion models to produce a multi-hypothesis pose distribution. It replaces costly likelihood pruning with a Mean Shift approach to isolate the mode as the final pose estimate, achieving state-of-the-art results on the REAL275 benchmark. The method also decouples detection from pose estimation, enabling robust zero-shot generalisation on the Wild6D dataset and extending naturally to video sequences by propagating the pose distribution over time.

By Adam Bethell, Ravi Garg, Ian Reid
arXiv Computer Vision
Oct 2

GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking

GenCOPE introduces a synthetic-to-real (Syn2Real) approach for category-level object pose estimation (COPE) that eliminates the need for labor-intensive real-world data collection. By learning domain-invariant representations through 2D and 3D semantic consistency constraints and employing an end-to-end pose regression framework with 2D-3D cross consistency, the model achieves robust generalization across synthetic and real domains. The architecture relies solely on global features, resulting in a lightweight and efficient design validated on REAL275, Wild6D, and real-world robotic manipulation scenes.

By Jian Liu, Wei Sun, Zhenqi Dai, Hui Yang, Jian Xiao, Nicu Sebe, Na Zhao
arXiv Computer Vision
Sep 16

PriorPose: Reference-Guided Joint Deformation and Alignment for Category-Level Object Pose Estimation

PriorPose introduces a reference-guided correspondence framework for category-level object pose estimation that jointly performs canonicalization and alignment in a shared feature space. By embedding partial observations and a category prior as token sets in a seeded transformer, the network predicts per-point NOCS fields and a canonical deformation, while a deep pose head regresses the similarity transform. A two-part shape consistency objective couples correspondence, deformation, and pose, reducing reliance on memorized canonical orientations and avoiding error cascades, leading to state-of-the-art results on standard and larger-category benchmarks, especially under strict pose thresholds.

By Yihan Chen, Huan Ren, Wenfei Yang, Hang Du, Tianzhu Zhang, Feng Wu
arXiv Computer Vision
Oct 9

Pose-Free Feed-Forward 3D Inpainting via Learnable Mask Attention and Support Token Refinement

FreeInpaint is a feed‑forward 3D inpainting framework that reconstructs complete, geometrically consistent scenes directly from unposed multi‑view images with masked regions. It extends a 3D foundation model by propagating masked areas across views, using a Learnable Mask Attention mechanism to maintain reliable cross‑view correspondences and a Support Token Refinement strategy that injects diffusion‑generated auxiliary tokens for high‑fidelity completion. Experiments on diverse datasets show that FreeInpaint delivers superior inpainting quality without requiring pre‑computed camera poses, while maintaining fast inference speed.

By Jingyi Pan, Dan Xu, Qiong Luo
arXiv Computer Vision
Oct 21

PURE: Refining Feed-forward 3D Reconstruction with Unlabeled Post-training

PURE is an unlabeled post‑training refinement framework that enhances feed‑forward 3D reconstruction models by improving depth and camera estimation without ground‑truth supervision. It distills structural knowledge from state‑of‑the‑art 2D priors into 4D architectures, using relative depth constraints, affine‑invariant geometry distillation, and pose refinement via feature correspondences. Experiments on synthetic and real‑world dynamic benchmarks show consistent improvements across multiple state‑of‑the‑art models, effectively mitigating domain shifts and unlocking their architectural limits in challenging in‑the‑wild scenes.

By Yaolong Zhu, Peng Li, Jiahao Lu, Chengfeng Zhao, Mengfei Li, Chao Wang, Wenyue Chen, Zekai Gu, Chengwei Ren, Ronggang Wang, Yuan Liu