arXiv Computer Vision

MuyBridge: Mobile Human Center-of-Mass Estimation from Monocular Video via Sparse Fusion

MuyBridge is an on-device system that estimates an athlete’s segmental center of mass (CoM) trajectory from a single phone camera video stream. It combines a compact 2D pose network with a distilled monocular depth network, fusing their outputs through anatomical and physical priors to produce metric CoM estimates without requiring 3D or task‑specific supervision. On the AthletePose3D dataset, MuyBridge achieves 33–41 mm vertical CoM error and 2.3–6.6 % absolute‑relative range error, delivering CoM estimates at 63 FPS on an iPhone 15 with asynchronous depth updates.

arXiv Computer Vision
Oct 2

Impact of Patient Orientation in Single- and Multi-View Camera Environments for AI-based Rehabilitation Monitoring

The paper introduces REHAB26-ViewAngles, a dataset of correct and incorrect rehabilitation exercise videos captured from many camera angles, and a new separability metric to evaluate pose‑estimation algorithms. It evaluates single‑camera 2D and 3D pose estimation and four multi‑camera approaches, showing that an optimally placed 2D camera can boost separability by 16.9% over a frontal view and that combining two views can improve accuracy by up to 13.1%. These findings provide concrete guidance for setting up camera systems in home and clinical rehabilitation monitoring.

By Miriama J\'ano\v{s}ov\'a, Andreas Lang, Petra Budikova, Jan Sedmidubsky
arXiv Computer Vision
Sep 16

MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild

MEgoVista is an offline pipeline that converts a single unprepared egocentric video into metric two‑hand and head motion within a gravity‑aligned world frame. It uniquely reconstructs motion in environments beyond studio volumes, uses calibrated stereo for absolute scale, and evaluates its outputs against independent optical capture to audit accuracy. The system thus expands the settings where high‑fidelity hand‑motion labels can be generated from natural, head‑worn recordings.

By Jiangong Xiao (Northwestern Polytechnical University), Zhihao Zhang (Xi'an Jiaotong University), Yifei Dong (Maniformer), Chao Ma (Maniformer), Zhouyi Jin (Maniformer), Zhiwen Hou (Maniformer), Li Liu (Maniformer), Weihuang Chen (Xi'an Jiaotong University), Hongbin Sun (Xi'an Jiaotong University), Maoqing Yao (Maniformer)
Hugging Face Trending Papers
Sep 28

One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMU

The study investigates how well a single consumer earbud IMU can estimate 3D body pose and whether adding foot IMUs improves accuracy. Using a multimodal capture pipeline with RGB‑D video, an AirPods head IMU, and Striv insole IMUs, the authors benchmark pose estimation across various motions and train recurrent models (IMUPoser and MobilePoser). Results show that a head IMU alone achieves 79.0 mm rigid‑MPJPE and 0.809 macro‑F1 for foot contact, while adding foot IMUs does not significantly improve pose and can even degrade performance due to insole orientation errors.

arXiv AI
Jun 10

Integrated Real-Time Motion Tracking and AI Analysis for Athletic Performance Optimization

arXiv:2606. 09842v1 Announce Type: cross Abstract: Applying Human Pose Estimation (HPE) in real world environments remains a challenging task, this paper explores and surveys real time HPE approaches and their limitations in sports analysis for individuals, alongside developing a practical lightweight prototype for real world testing and usage.

By Parth Agrawal, Ronit, Sagar Kumar, Aashish Bhambri