arXiv AI

Smartphone-Aided VR Exergames for HIIT: Gamifying Fitness with Real-Time Pose Estimation

The paper presents a VR exergame that gamifies High‑Intensity Interval Training (HIIT) using 11 predefined combo moves and a standard smartphone camera on a tripod for full‑body pose estimation. Real‑time biomechanical data are processed by a backend built on the Model Context Protocol and GPT‑4o to provide personalized feedback on form, efficiency, intensity, and injury risk. A within‑subject study with 20 participants showed higher enjoyment, immersion, and recommendation likelihood in VR sessions compared to non‑VR, while the MCP system’s feedback agreed strongly with expert evaluation.

arXiv AI
Jun 10

Integrated Real-Time Motion Tracking and AI Analysis for Athletic Performance Optimization

arXiv:2606. 09842v1 Announce Type: cross Abstract: Applying Human Pose Estimation (HPE) in real world environments remains a challenging task, this paper explores and surveys real time HPE approaches and their limitations in sports analysis for individuals, alongside developing a practical lightweight prototype for real world testing and usage.

By Parth Agrawal, Ronit, Sagar Kumar, Aashish Bhambri
arXiv AI
Aug 25

Vision-Language Models for Occupational Physical Exposure Assessment: Estimating External Hand Forces in Manual Material Handling Tasks from RGB Video

The study presents a vision‑language model pipeline that estimates dynamic, triaxial, bilateral external hand forces during manual material handling tasks using only RGB video and known box mass. By combining text‑guided ROI localization, pretrained vision‑transformer features, and transformer‑based temporal regression, the model achieved root mean square errors of about 4.7–5.6 N for horizontal and mediolateral forces and 10.6–11.0 N for vertical forces across various camera setups. The approach demonstrated that including the handled object as a second ROI and using multi‑camera capture improved peak‑force estimation, showing the feasibility of sensor‑free force estimation for occupational exposure assessment.

By Mohammad Sadra Rajabi, Aanuoluwapo Ojelade, Sunwook Kim, Maury A. Nussbaum
arXiv Computer Vision
Sep 3

MuyBridge: Mobile Human Center-of-Mass Estimation from Monocular Video via Sparse Fusion

MuyBridge is an on-device system that estimates an athlete’s segmental center of mass (CoM) trajectory from a single phone camera video stream. It combines a compact 2D pose network with a distilled monocular depth network, fusing their outputs through anatomical and physical priors to produce metric CoM estimates without requiring 3D or task‑specific supervision. On the AthletePose3D dataset, MuyBridge achieves 33–41 mm vertical CoM error and 2.3–6.6 % absolute‑relative range error, delivering CoM estimates at 63 FPS on an iPhone 15 with asynchronous depth updates.

By Aidan Bradshaw, Marco Giordano, David Rode, Andreas Habersack, Elif Basokur, Annika Kruse, Markus Tilp, Michele Magno, Peter Wolf, Luca Benini, Christoph Leitner
arXiv Computer Vision
Oct 2

Impact of Patient Orientation in Single- and Multi-View Camera Environments for AI-based Rehabilitation Monitoring

The paper introduces REHAB26-ViewAngles, a dataset of correct and incorrect rehabilitation exercise videos captured from many camera angles, and a new separability metric to evaluate pose‑estimation algorithms. It evaluates single‑camera 2D and 3D pose estimation and four multi‑camera approaches, showing that an optimally placed 2D camera can boost separability by 16.9% over a frontal view and that combining two views can improve accuracy by up to 13.1%. These findings provide concrete guidance for setting up camera systems in home and clinical rehabilitation monitoring.

By Miriama J\'ano\v{s}ov\'a, Andreas Lang, Petra Budikova, Jan Sedmidubsky
arXiv AI
Sep 1

Toward Postural State Classification in Immersive VR with Multimodal Data and Explainability Analysis

This study evaluates machine learning and deep‑learning models for classifying balanced versus imbalanced postural states in immersive virtual reality using a multimodal dataset of kinematic, EMG, and EDA signals. The Mamba‑inspired CNN (MI‑CNN) achieved the highest accuracy (96.76%) and, through SHapley Additive exPlanations (SHAP), identified kinematic features as the most influential for detecting imbalance. Even after reducing input dimensionality by 33% based on SHAP importance, the model maintained near‑optimal performance (0.957 accuracy and F1‑score).

By Nipa Anjum, Md Irfan Pavel, Robert Gonzalez Jr, Kevin Desai, Alberto Cordova, M. Rasel Mahmud, John Quarles