The paper introduces Vocabulary‑Guided Gait Recognition (Gait‑World), a new paradigm that leverages human vocabularies and Vision‑Language Models (VLMs) to better understand and recognize gait. It proposes the α‑Gait model, which uses a Vocabulary Relation Mapper and a Gait Fine‑grained Detector to align vocabulary prompts with gait features, addressing the challenge of heterogeneous embedding spaces. Experiments on multiple gait datasets demonstrate the potential of incorporating VLM‑derived vocabulary information into gait recognition.
By Panjian Huang, Saihui Hou, Chunshui Cao, Xu Liu, Yongzhen Huang
arXiv:2607. 06617v1 Announce Type: cross Abstract: Wearable motion sensing provides a continuous and scalable window into human behavior and health, making it a natural fit for foundation models, yet its pretraining and scaling principles remain poorly understood.
By Zongzhe Xu, Aakarsh Anand, Sarah Jiang, Chuntung Zhuang, Zitao Shuai, Sriram Sankararaman, Yuzhe Yang
The paper introduces GaitMoE, an action‑detection based mixture‑of‑experts framework for occluded gait recognition, leveraging temporal and action experts to infer missing body parts from adjacent frames and gait cycles. It also presents a new Occluded Gait database (OccGait) with diverse occlusion scenarios and annotations, and demonstrates superior performance on OccGait, OccCASIA‑B, Gait3D, and GREW datasets.
By Panjian Huang, Yunjie Peng, Saihui Hou, Chunshui Cao, Xu Liu, Zhiqiang He, Yongzhen Huang
The paper presents a new framework that classifies healthy gait and multiple musculoskeletal impairment groups using bilateral ground reaction force (GRF) and center-of-pressure (COP) signals. After normalizing and standardizing the signals, the model achieved 99.00% validation accuracy and 90.07% test accuracy with a session-level split. The approach includes class‑specific ε‑LRP explainability and synchronizes processed GRF signals with model predictions in a Blender‑based 3D visualization for sample‑level inspection.
By Nayoung Son, Minwoo Shin
MMGait is a large‑scale multi‑sensor benchmark that aligns visible, infrared, depth, LiDAR, and radar observations at the sequence level, enabling evaluation of single‑modal, cross‑modal, and multi‑modal gait recognition. The study shows that modality rankings shift with probe conditions, cross‑modal alignment remains challenging, and fusion can yield complementary gains. To address the scalability issue of training separate experts, the authors propose Omni‑Modal Gait Recognition and its implementation, OmniGait++, which unifies all recognition settings within a shared identity space using modality‑specific front ends, a shared encoder, and an anchor‑guided fusion module.
whyItMatters":"MMGait provides a common testbed for heterogeneous gait sensing and demonstrates that unified recognition across varying modality availability is feasible, offering a scalable alternative to task‑specific experts."
By Saihui Hou, Chenye Wang, Qingyuan Cai, Aoqi Li, Yongzhen Huang
arXiv:2609.10187v1 Announce Type: new
Abstract: In this work, we introduce language-aligned motion representations for domain-generalizable UPDRS-Gait severity estimation, aiming to learn semanticall...
By Soojie Kim, Muhammad Munsif, Minkyung Kim, Seungryul Baek
The paper introduces Composed Gait Retrieval (CoGR), a task that retrieves a target gait sequence using a reference sequence and a natural language modification query. To support this, the authors create the first gait-language datasets—Language‑Augmented CCPG and Language‑Augmented CASIA‑B—via an automated annotation pipeline powered by large vision‑language models. They propose ComposeGait, an identity‑anchored composition framework with a Part‑aware Identity Adapter that injects identity tokens into a shared Q‑Former, achieving state‑of‑the‑art retrieval performance on both benchmarks.
By Jingchen Fei, Zengbin Wang, Yukun Liu, Muyi Sun, Shibiao Xu, Man Zhang
arXiv:2609.01036v1 Announce Type: cross
Abstract: A lack of suitable datasets has limited the research into the privacy risks of novel smart city sensors, such as thermal cameras, depth cameras, and...
By Julian Todt, Felix Morsbach, Philip Dissert, Thorsten Strufe
arXiv:2609.18490v1 Announce Type: new
Abstract: "What I cannot create, I do not understand."Human wisdom reveals that creation is one of the highest forms of learning. For example, Diffusion Models h...
By Panjian Huang, Saihui Hou, Junzhou Huang, Yongzhen Huang
arXiv:2608. 13316v1 Announce Type: cross Abstract: Foundation models (FMs) trained on large-scale accelerometer data have been proposed as general-purpose feature extractors for health monitoring, but systematic evidence of their advantages is lacking.
By Alexander Br\"auer, Benjamin Cauchi, Nils Strodthoff
arXiv:2609.08038v2 Announce Type: cross
Abstract: Smart healthcare monitoring systems require precise action recognition to ensure well-being and timely intervention in critical situations such as fa...
By Diwas Lamsal, Pramod Wickramatilake, Jednipat Moonrinta, Mongkol Ekpanyapong, Matthew N. Dailey
The paper introduces the first federated learning framework for infant movement analysis, specifically targeting General Movement Assessment using skeletal motion data. It employs Monte Carlo Dropout to estimate predictive uncertainty and proposes an Uncertainty-Aware Federated Averaging (UA‑FedAvg) strategy that weights client updates by this uncertainty. Experiments with three clients show that federated learning outperforms local models and approaches centralized training performance, with UA‑FedAvg generally surpassing standard FedAvg.
By Edmond S. L. Ho