arXiv AI

Radar-Based 3D Human Pose Estimation via Motion-Aware Pose Initialization and Observation-Guided Refinement

Hugging Face Trending Papers
Aug 4

Learning Biomechanically Plausible Human Motion from Sparse Radar Point Clouds

Radar-based human pose estimation has focused on improving learning algorithms while representing the body as unconstrained keypoint coordinates. We address the underexplored dimension of anatomical fidelity by integrating a full-body skeletal model into a differentiable, end-to-end trainable radar-based pose estimation framework, in which the pose network is supervised through forward kinematics while subject-specific geometry is fitted beforehand.

arXiv Computer Vision
Oct 7

WiSPER: Pose-Supervised Predictive and Residual Flow Refinement For Multi-Person 3D Pose Estimation With WiFi CSI

WiSPER is a two‑stage framework for multi‑person 3D pose estimation using WiFi channel state information (CSI). The first stage, Pose‑Aware Masked Embedding Learning (PAMEL), couples masked latent prediction with pose‑set supervision to guide the encoder toward joint localization from partial observations. The second stage, Residual Flow refinement with Transformer (ReFT), generates pose candidates for a variable number of people and refines each candidate through a conditional flow guided by coarse coordinates and decoder features. Trained with paired CSI and pose annotations, WiSPER achieves a mean per‑joint position error of 63.72 mm on the PiW3D dataset, a 40.0 % improvement over WiFi‑JEPA and significant reductions for two‑ and three‑person scenarios.

By Gabriel Lee Jun Rong, Shanhong Liu, Pai Chet Ng, Konstantinos N. Plataniotis, Jamal Seyedmohammadi, S. Mohammad Sheikholeslami
arXiv Computer Vision
5d ago

UT-HMR: Uncertainty-Guided Temporal Modeling for Robust 3D Human Mesh Recovery

UT‑HMR is a one‑stage monocular 3D human mesh recovery framework that introduces uncertainty‑guided temporal modeling to address ambiguities caused by weak observations such as distance, occlusion, and motion blur. It predicts a Gaussian distribution over SMPL pose with a low‑rank-plus‑diagonal covariance, converting this into joint‑wise precision weights for heteroscedastic supervision while keeping inference deterministic. Temporal early fusion incorporates neighboring‑frame evidence before pose decoding, enabling the model to resolve pose ambiguities and achieve state‑of‑the‑art results on VIP‑HockeyPose‑v2, WorldPose, and competitive performance on 3DPW using a lightweight ViT‑B backbone.

By Zhibo Wang, Sirisha Rambhatla, Yuhao Chen, Maria Koshkina, David Clausi
arXiv AI
Sep 7

Sound-based Multi-Person 3D Pose Estimation

The paper introduces SoundMHPE, an encoder‑decoder framework that estimates 3D poses of multiple people using only acoustic signals. It addresses challenges such as overlapping acoustic signatures and inter‑person reflections by employing a multi‑scale acoustic encoder and a temporal pose decoder with attention. The authors created the 6‑hour Acoustic Multi‑person Pose (AMP) dataset and show that SoundMHPE outperforms baseline models.

By Yusuke Oumi, Yuto Shibata, Go Irie, Akisato Kimura, Yoshimitsu Aoki, Mariko Isogawa
Hugging Face Trending Papers
Sep 4

Sound-based Multi-Person 3D Pose Estimation

The paper introduces SoundMHPE, the first system to estimate multi‑person 3D poses using only acoustic signals. It tackles challenges such as overlapping acoustic signatures and inter‑person reflections by employing an Acoustic Multi‑scale Encoder and a Temporal Pose Decoder with attention. The authors built a 6‑hour Acoustic Multi‑person Pose dataset and show that SoundMHPE outperforms baseline models.