arXiv AI

Joint-Embedding Predictive Architecture for Sensor-based Activity Recognition

arXiv:2607. 16350v1 Announce Type: cross Abstract: Sensor-based human activity recognition (HAR) has achieved significant progressed in fully supervised learning settings.

arXiv AI
Sep 16

Coverage-Aware Virtual IMU Augmentation for Low-Resource Human Activity Recognition

The paper introduces a coverage-aware virtual IMU augmentation framework for human activity recognition. It selects diverse and scarce data points in a learned sensor embedding space, generates virtual IMU samples as prompts, ranks them by proximity and label consistency, and incorporates them into training with reliability-based weights. Experiments on public benchmarks demonstrate consistent performance gains over existing baselines, with ablation studies confirming the framework’s effectiveness.

By Jiayuan Gao, Yingwei Zhang, Ziyao Tang, Yuejia Ma, Yuanzhe Chen, Shuchao Song, Boshi Tang
arXiv Machine Learning
Aug 28

HALO: A Heterogeneity-Aware Language-Aligned IMU Foundation Model for Open-Set Human Activity Recognition

HALO is a heterogeneity‑aware, language‑aligned foundation model for inertial measurement unit (IMU) based human activity recognition. It uses a two‑stage training process: first, a self‑supervised encoder learns to handle diverse sensor configurations and natural‑language sensor descriptions; second, the encoder is aligned with text embeddings through synonym‑aware contrastive learning, enabling open‑set recognition via cosine similarity. Trained on ten public HAR datasets, HALO outperforms five state‑of‑the‑art baselines across eight metrics while using only ~35 M parameters, and improves zero‑shot open‑set accuracy by 13.7 percentage points over 87 training labels.

By Zihan Ding, Liyu Zhang, Xiaomin Ouyang