Hugging Face Trending Papers

F2G-Pose: Geometry-Aware Foundation Feature Lifting for Direct RGB-D Category-Level Object Pose Estimation

Read the original on Hugging Face Trending Papers →

F2G-Pose is a real‑time, single‑pass framework for category‑level RGB‑D object pose estimation that predicts pose, metric size, and camera‑frame completed shape from a single RGB‑D observation. It lifts dense visual foundation features to partial point clouds, encodes local geometry with DGCNN tokenization, and uses a Mixture‑of‑Experts Transformer to integrate object‑level structure. Trained only on pose‑annotated synthetic SOPE data with a frozen RADIO backbone, it achieves state‑of‑the‑art accuracy on SOPE and ROPE while running at 28 FPS for pose‑only inference and demonstrates strong geometry on HouseCat6D and real‑object transfer on HANDAL.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Computer Vision
5d ago

F2G-Pose: Geometry-Aware Foundation Feature Lifting for Direct RGB-D Category-Level Object Pose Estimation

F2G-Pose is a real‑time, single‑pass framework for category‑level RGB‑D object pose estimation that predicts 3D rotation, translation, metric size, and a completed camera‑frame shape from a single RGB‑D observation. It lifts dense visual foundation features to partial point clouds, encodes local geometry with DGCNN tokenization, and uses a Mixture‑of‑Experts Transformer to integrate object‑level structure. Trained only on pose‑annotated synthetic SOPE data and leveraging a frozen RADIO backbone, F2G‑Pose achieves state‑of‑the‑art accuracy on SOPE and ROPE while running at 28 FPS for pose‑only inference and demonstrates strong geometry completion on HouseCat6D and real‑object transfer on HANDAL.

By Jinyu Zhang, Haitao Lin, Jiashu Hou, Xiangyang Xue, Yanwei Fu
arXiv Computer Vision
Oct 5

RYOPO: Bringing End-to-End Category-Level Object Pose Estimation into Real Time

RYOPO is an end‑to‑end query‑based RGB‑D set predictor that jointly detects, segments, and estimates 9‑DoF poses of unseen instances within known categories without relying on external instance segmentation or CAD priors. It uses shared image and scene encoding, a query‑conditioned geometry pathway, and object‑centric refinement with pose‑conditioned cross‑attention to achieve accurate pose estimation. On benchmark datasets such as NOCS, REAL275, and HouseCat6D, RYOPO outperforms published methods and runs in real time at 31.8 FPS on an RTX A6000.

By Hakjin Lee, Junghoon Seo, Jaehoon Sim
Hugging Face Trending Papers
Oct 8

PointVGGT: Zero-Shot Multiview RGB-D Point Cloud Registration with Visual Geometry Foundation Priors

The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that avoids pairwise estimation by using a foundation‑then‑refinement paradigm. In the foundation stage, it recovers metrically consistent global poses by grounding scale‑ambiguous predictions from visual geometry foundation models against metric depth. The refinement stage employs voxelized spatial hashing and IRLS‑based bundle adjustment to efficiently refine poses, achieving high accuracy and computational efficiency across indoor, object‑centric, and outdoor datasets.

arXiv Computer Vision
Oct 9

PointVGGT: Zero-Shot Multiview RGB-D Point Cloud Registration with Visual Geometry Foundation Priors

The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that replaces the traditional pairwise‑then‑global pipeline. It employs a foundation‑then‑refinement paradigm, using visual geometry foundation models to directly recover metrically consistent global poses and then refining them with voxelized spatial hashing and IRLS‑based bundle adjustment. Experiments on indoor, object‑centric, and outdoor datasets demonstrate superior registration accuracy and computational efficiency without any training.

By Haobo Jiang, Liang Yu, Jianmin Zheng
arXiv Computer Vision
Sep 22

G6D: Geometric Learning-Free RGB-D 6D Pose Solver for Robotic Manipulation

G6D is a learning‑free, geometry‑driven RGB‑D 6D pose solver designed for robotic manipulation. It generates pose hypotheses via template‑based geometric matching and refines them using silhouette and depth consistency, requiring only an RGB‑D observation, an object mask, camera intrinsics, and a CAD model. The method offers adjustable accuracy‑computation trade‑offs, can run on CPU without GPUs, and has shown strong performance on LineMOD and BOP19 datasets, as well as in real‑world pick‑and‑place experiments.

By Yixuan Liang (Tsinghua University), William Chen (Sapient Intelligence), Yunan Wang (Tsinghua University), Jizhou Yan (Tsinghua University), Zhao Jin (Tsinghua University), Changling Liu (Sapient Intelligence), Chuxiong Hu (Tsinghua University)