RoPE-Flow is an end‑to‑end framework that estimates camera‑to‑robot pose from a single monocular image using flow matching. It extracts keypoint‑centered features from predicted 2D heatmaps and employs a graph‑guided condition generator to encode keypoint correlations for flow matching. The method introduces Bone Length Loss and Ray‑Depth Loss to enforce topological consistency and scale stability, and demonstrates superior performance over state‑of‑the‑art approaches on multiple robot types and a new cross‑scene benchmark.
arXiv:2603.12064v3 Announce Type: replace Abstract: We address the challenging problem of dense dynamic scene reconstruction and camera pose estimation from multiple freely moving cameras -- a settin...
arXiv:2609.38443v1 Announce Type: cross Abstract: We introduce BIND, a new action representation for visuomotor robot policies that binds 3D robot actions to their corresponding 2D image features, yi...
SFVO is a stereo visual‑odometry framework that leverages pretrained stereo‑matching and optical‑flow models to obtain dense stereo and temporal correspondences. Rather than learning pose directly from images, it maps these correspondences into geometric constraints and predicts trustworthy points using decoupled confidence maps for rotation and translation. Experiments on both outdoor and indoor datasets show that SFVO delivers robust, accurate pose estimation with strong generalization, and the authors plan to release the code.
arXiv:2610.34845v1 Announce Type: new Abstract: Recent multi-view Transformers (e.g., DUSt3R and VGGT) have advanced 3D reconstruction by scaling training data and model capacity from two views to ma...
TAPVid-MV is a new benchmark for tracking any point in 3D across multiple synchronized camera views. It comprises 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks, covering indoor and outdoor domains and derived from various modalities such as depth, LiDAR, SLAM, and simulation. The dataset is visually verified, and evaluation shows that current multi‑view trackers do not consistently outperform monocular trackers, highlighting geometry recovery as a key bottleneck.
arXiv:2610.35501v1 Announce Type: new Abstract: Learning-based structure-from-motion methods such as ACE-Zero have demonstrated strong performance in estimating cameraposes and scene coordinates from...
The paper introduces PICO, an end-to-end trainable model for 6DoF surgical tool pose estimation that uses multi-task learning to predict segmentation, depth, and pose parameters. It incorporates two geometry-aware proxy tasks—a projection loss and a point-to-point loss—to enforce consistency in 2D and 3D spaces, improving accuracy and robustness. Evaluated on the SurgRIPE dataset, PICO achieves strong performance, ranking second in rotation accuracy and maintaining competitive translation results, especially under occlusion.
arXiv:2609.09394v1 Announce Type: new Abstract: Recovering metric 3D geometry from monocular images is a fundamental computer vision task, yet current methods remain heavily fragmented by fixed camer...
arXiv:2604.28130v4 Announce Type: replace Abstract: Recent methods for arbitrary-skeleton motion capture from monocular video follow a factorized pipeline, where a Video-to-Pose network predicts join...
Learning-based structure-from-motion methods such as ACE-Zero have demonstrated strong performance in estimating cameraposes and scene coordinates from unordered image collections without requiring gr...
Kineo is a fully automatic, calibration‑free pipeline that performs markerless motion capture using unsynchronized, uncalibrated consumer‑grade RGB cameras. It uses 2D keypoints from existing detectors to jointly calibrate cameras (including distortion), reconstruct 3D keypoints, and generate dense scene pointmaps at metric scale. The method introduces confidence‑aware subsampling, graph‑based optimization, and a pairwise reprojection consistency score to achieve robust calibration and accurate metric scale recovery, achieving significant error reductions on EgoHumans and Human3.6M datasets while remaining computationally efficient.
arXiv:2605.18553v2 Announce Type: replace-cross Abstract: Recovering world space 4D motion of two interacting hands from egocentric video is a fundamental capability for supervising robot policy lear...