arXiv AI

Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessment

arXiv:2202. 14019v3 Announce Type: replace-cross Abstract: Maintaining proper form while exercising is important for preventing injuries and maximizing muscle mass gains.

arXiv Computer Vision
Sep 17

Pose2Muscle: Structured Spatio-Temporal Decoding for Discrete Muscle Activity Estimation from Human Pose

Pose2Muscle is a pose-driven framework that estimates discrete muscle activity states without requiring surface electromyography (sEMG) during inference. It reformulates muscle estimation as a structured prediction problem, using multi-scale spatio-temporal attention and a directed acyclic graph-based decoder to capture motion patterns and maintain multiple candidate hypotheses. The authors introduce the PoseEMG-43 dataset, comprising 2,992 movement instances from 43 daily-life actions performed by 14 participants, and demonstrate that Pose2Muscle outperforms baseline methods with high accuracy and correlation metrics.

By Yuepeng Chen, Jiehong Shi, Kaili Zheng, Boyi Zhang, Chenyi Guo, Ji Wu, Xiangling Fu
arXiv Machine Learning
Aug 27

MyoMechanix: Biomechanically-Grounded Compositional Skilled Activity Understanding and Coaching

MyoMechanix is a multimodal dataset and framework for action quality assessment that incorporates muscle activity and other physiological signals alongside visual data. It contains over 7,500 samples of 20 weight‑loaded actions from 38 subjects, with synchronized RGB video, 3D pose, sEMG, and additional signals. The accompanying Fitness Knowledge Graph structures expert annotations into relationships among actions, phases, key steps, errors, and corrective feedback, enabling compositional scoring and interpretable assessment through the CUBIST engine. The project also introduces MyoMechanix‑AQA, MyoMechanix‑VideoQA, and a novel MyoMechanix‑Video2EMG task, demonstrating that multimodal sensing and structured representations improve performance, interpretability, and error attribution.

By Hao Yin, Paritosh Parmar, Lijun Gu, Lin Xu, Tianxiao Guo, Xiujin Liu, Tianyou Zheng, Yang Zhang, Weiwei Fu
arXiv Computer Vision
Sep 18

SAGE-Yoga: Multi-Cue Learning for Yoga Pose Classification and Joint-Level Correction

SAGE-Yoga is a unified coarse‑to‑fine framework that performs yoga pose classification and joint‑level correction from a single RGB image. It uses a bagging ensemble of complementary visual backbones to rank candidate pose classes, a margin‑based gating mechanism to selectively apply geometric verification, and a medoid reference pose to compare joint angles against class‑specific distributions. On the Yoga‑82 dataset, the ensemble achieves 89.0% Top‑1 accuracy, while the full system reaches 90.7% Top‑1 accuracy and 90.1% Macro‑F1, demonstrating improved fine‑grained classification and interpretable corrective feedback.

By Hung Le Chi, Khanh Minh Huynh, Long Nghia Tran Pham, Tan Phuc Huynh, Trong-Thuan Nguyen, Minh-Triet Tran