arXiv Computer Vision

MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons

arXiv Computer Vision
Oct 23

MoRE: Motion-Regularized Encoding for Articulated 3D Generation

MoRE introduces a Motion-Regularized Encoding for generating articulated 3D objects from a single image. It encodes joint attributes as coordinate‑aligned joint lines with axis classification and Plücker moment coefficients, and couples attribute reconstruction to motion through a differentiable expectation over joint types and axis directions. Experiments on PartNet‑Mobility and ACD demonstrate improved part‑box agreement, articulated‑state geometry, visual similarity, and reduced joint prediction errors compared to prior methods.

By Guantian Zheng, Shan Jin
arXiv Computer Vision
Oct 5

RYOPO: Bringing End-to-End Category-Level Object Pose Estimation into Real Time

RYOPO is an end‑to‑end query‑based RGB‑D set predictor that jointly detects, segments, and estimates 9‑DoF poses of unseen instances within known categories without relying on external instance segmentation or CAD priors. It uses shared image and scene encoding, a query‑conditioned geometry pathway, and object‑centric refinement with pose‑conditioned cross‑attention to achieve accurate pose estimation. On benchmark datasets such as NOCS, REAL275, and HouseCat6D, RYOPO outperforms published methods and runs in real time at 31.8 FPS on an RTX A6000.

By Hakjin Lee, Junghoon Seo, Jaehoon Sim
arXiv Computer Vision
Oct 23

F2G-Pose: Geometry-Aware Foundation Feature Lifting for Direct RGB-D Category-Level Object Pose Estimation

F2G-Pose is a real‑time, single‑pass framework for category‑level RGB‑D object pose estimation that predicts 3D rotation, translation, metric size, and a completed camera‑frame shape from a single RGB‑D observation. It lifts dense visual foundation features to partial point clouds, encodes local geometry with DGCNN tokenization, and uses a Mixture‑of‑Experts Transformer to integrate object‑level structure. Trained only on pose‑annotated synthetic SOPE data and leveraging a frozen RADIO backbone, F2G‑Pose achieves state‑of‑the‑art accuracy on SOPE and ROPE while running at 28 FPS for pose‑only inference and demonstrates strong geometry completion on HouseCat6D and real‑object transfer on HANDAL.

By Jinyu Zhang, Haitao Lin, Jiashu Hou, Xiangyang Xue, Yanwei Fu
arXiv Computer Vision
Sep 28

PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation

The paper introduces PICO, an end-to-end trainable model for 6DoF surgical tool pose estimation that uses multi-task learning to predict segmentation, depth, and pose parameters. It incorporates two geometry-aware proxy tasks—a projection loss and a point-to-point loss—to enforce consistency in 2D and 3D spaces, improving accuracy and robustness. Evaluated on the SurgRIPE dataset, PICO achieves strong performance, ranking second in rotation accuracy and maintaining competitive translation results, especially under occlusion.

By Lucy Fothergill, Pietro Valdastri, Dominic Jones, Duygu Sarikaya