arXiv Machine Learning

Deep Multimodal Wearable Sensor Fusion for Detection of Body-Focused Repetitive Behaviors

arXiv:2608. 09830v1 Announce Type: new Abstract: Body-focused repetitive behaviors, such as hair pulling and skin picking, are compulsive motor actions commonly associated with obsessive-compulsive and anxiety disorders.

arXiv Machine Learning
Sep 21

From Stress to Affect: Multimodal Deep Learning for Physiological Emotion Recognition Across Wearable Sensor Modalities

The study compares temporal deep learning models—Bidirectional LSTM, Temporal Convolutional Network, and Transformer—for physiological emotion recognition using two multimodal wearable datasets, WESAD and EmoWear. Experiments evaluate wrist-only, chest-only, and multimodal sensor configurations with participant-independent leave-one-subject-out cross-validation, and also explore ensembles, sensor ablation, sampling frequency, and saliency analysis. Results show that the best architecture varies by dataset, multimodal sensing consistently outperforms single-site configurations, and a 4 Hz sampling rate offers a cost-effective operating point.

By Desta Haileselassie Hagos, Saurav Keshari Aryal, Legand L. Burge
arXiv Machine Learning
Sep 1

Learning Human Health and Diseases from 24-hour Wrist Movement

The paper introduces Sensori, a self‑supervised foundation model that learns health representations from 24‑hour raw tri‑axial wrist movement data. Trained on 122,640 participants across the UK, China, and the US, Sensori captures diverse movement behaviours, demographics, health axes, and physical function. In independent cohorts, the model improved disease classification for 52 of 102 conditions and incident disease risk prediction for 26 of 87 conditions, especially for neurological and psychiatric disorders.

By Yong Wang, Dylan McGagh, Katya Broomberg, Zizheng Zhang, Jonathan Carter, Junayed Naushad, Laura Brocklebank, Yang Sun, George Nicholson, Dianjianyi Sun, Canqing Yu, Jun Lv, Maxim Barnard, Hubert Lam, Andrew Steptoe, David W. Eyre, Liming Li, Zhengming Chen, Naomi Wray, Spiros Denaxas, Gary S. Collins, Huaidong Du, Aiden Doherty, Hang Yuan
arXiv AI
Sep 1

Toward Postural State Classification in Immersive VR with Multimodal Data and Explainability Analysis

This study evaluates machine learning and deep‑learning models for classifying balanced versus imbalanced postural states in immersive virtual reality using a multimodal dataset of kinematic, EMG, and EDA signals. The Mamba‑inspired CNN (MI‑CNN) achieved the highest accuracy (96.76%) and, through SHapley Additive exPlanations (SHAP), identified kinematic features as the most influential for detecting imbalance. Even after reducing input dimensionality by 33% based on SHAP importance, the model maintained near‑optimal performance (0.957 accuracy and F1‑score).

By Nipa Anjum, Md Irfan Pavel, Robert Gonzalez Jr, Kevin Desai, Alberto Cordova, M. Rasel Mahmud, John Quarles
arXiv AI
Jul 9

Inertia-1: An Open Exploration of Wearable Motion Foundation Models

arXiv:2607. 06617v1 Announce Type: cross Abstract: Wearable motion sensing provides a continuous and scalable window into human behavior and health, making it a natural fit for foundation models, yet its pretraining and scaling principles remain poorly understood.

By Zongzhe Xu, Aakarsh Anand, Sarah Jiang, Chuntung Zhuang, Zitao Shuai, Sriram Sankararaman, Yuzhe Yang
arXiv AI
Jun 2

Interpretable Multimodal Gesture Recognition for Drone and Mobile Robot Teleoperation via Log-Likelihood Ratio Fusion

arXiv:2602. 23694v3 Announce Type: replace-cross Abstract: Human operators are still frequently exposed to hazardous environments such as disaster zones and industrial facilities, where intuitive and reliable teleoperation of mobile robots and Unmanned Aerial Vehicles (UAVs) is essential.

By Seungyeol Baek, Jaspreet Singh, Lala Shakti Swarup Ray, Hymalai Bello, Paul Lukowicz, Sungho Suh