arXiv Computer Vision

UT-HMR: Uncertainty-Guided Temporal Modeling for Robust 3D Human Mesh Recovery

UT‑HMR is a one‑stage monocular 3D human mesh recovery framework that introduces uncertainty‑guided temporal modeling to address ambiguities caused by weak observations such as distance, occlusion, and motion blur. It predicts a Gaussian distribution over SMPL pose with a low‑rank-plus‑diagonal covariance, converting this into joint‑wise precision weights for heteroscedastic supervision while keeping inference deterministic. Temporal early fusion incorporates neighboring‑frame evidence before pose decoding, enabling the model to resolve pose ambiguities and achieve state‑of‑the‑art results on VIP‑HockeyPose‑v2, WorldPose, and competitive performance on 3DPW using a lightweight ViT‑B backbone.

arXiv Computer Vision
Sep 18

DirtyMoCap: Robust Motion Capture from Unconstrained Markers

DirtyMoCap is a marker‑layout‑free framework that converts unordered, noisy optical motion capture markers into a fixed set of proxy anchors representing skeletal joints and body surface points. Using a recurrent sliding‑window architecture to track these anchors and a custom differentiable Gauss‑Newton solver to fit the SMPL‑H model, the method learns adaptive observation confidence, smoothness, and prior weights end‑to‑end. Experiments show that DirtyMoCap generalizes across arbitrary marker configurations, outperforms configuration‑specific baselines in joint and vertex accuracy, and achieves up to a 100× speedup over standard PyTorch implementations, enabling the creation of a temporally coherent Kung Fu motion dataset.

By Long Wang, Shuting Zhao, Shen Yan, Siyuan Yu, Xiaoben Li, Zeyu Cai, Yumeng Hou, Yuliang Xiu
arXiv Computer Vision
Sep 15

MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons

arXiv:2604.28130v4 Announce Type: replace Abstract: Recent methods for arbitrary-skeleton motion capture from monocular video follow a factorized pipeline, where a Video-to-Pose network predicts join...

By Kehong Gong, Zhengyu Wen, Dao Thien Phong, Mingxi Xu, Weixia He, Qi Wang, Ning Zhang, Zhengyu Li, Guanli Hou, Dongze Lian, Xiaoyu He, Mingyuan Zhang, Hanwang Zhang