arXiv Computer Vision
Sep 17

Occluded Gait Recognition with Mixture of Experts: An Action Detection Perspective

The paper introduces GaitMoE, an action‑detection based mixture‑of‑experts framework for occluded gait recognition, leveraging temporal and action experts to infer missing body parts from adjacent frames and gait cycles. It also presents a new Occluded Gait database (OccGait) with diverse occlusion scenarios and annotations, and demonstrates superior performance on OccGait, OccCASIA‑B, Gait3D, and GREW datasets.

By Panjian Huang, Yunjie Peng, Saihui Hou, Chunshui Cao, Xu Liu, Zhiqiang He, Yongzhen Huang
arXiv AI
Oct 28

SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding

SOMA is a new benchmark that tests fine‑grained egocentric body‑motion understanding, featuring 1,632 human‑verified questions across body configuration, motion dynamics, and temporal reasoning. The study evaluates 37 multimodal large language models (MLLMs) and finds that humans achieve 68.5% accuracy while the best MLLM (Qwen3.6‑27B) reaches only 50.0% zero‑shot accuracy. The authors also provide a training dataset and a multimodal baseline to help close the performance gap and highlight common failure modes such as misreading body parts and temporal errors.

By Matea Tashkovska, Na\"el Ouerghemi, Haozhe Qi, Alexander Mathis
arXiv Computer Vision
2d ago

Movens-Zero: Scaling Humanoid Motion Foundation Models with Large-Scale Human Videos

The paper introduces Movens-5M, a dataset of 15 million human‑motion sequences and 5 million humanoid‑executed motions derived from raw Internet videos, aligned with text, RGB video, speech, and music. Using this data, the authors present Movens‑Zero, a scalable architecture that jointly learns across modalities and supports real‑time closed‑loop execution, enabling motion generation from text, speech, music, and video. They also release Movens‑Intent, a benchmark of 8,192 expert‑verified condition‑motion pairs, and demonstrate that scaling data quality and model capacity improves performance across all modalities.

By Wendong Bu, Tinghong Ye, Qizhou Wang, Jiacheng Li, Zhiqi Ge, Yuze Lin, Zhongqi Yue, Yi Su, Jingyu Wang, Kai Shen, Jingdong Liu, Chengyuan Deng, Xiaoxuan Chen, Xin Tan, Jiaming Ji, Wenqiao Zhang, Chenghong Jiang, Tuoyu Li, Siliang Tang, Jun Xiao, Tat-Seng Chua, Yueting Zhuang, Xingxing Wang, Juncheng Li