arXiv Computer Vision

Learning A Unified Template for Gait Recognition

arXiv Computer Vision
Sep 17

Vocabulary-Guided Gait Recognition

The paper introduces Vocabulary‑Guided Gait Recognition (Gait‑World), a new paradigm that leverages human vocabularies and Vision‑Language Models (VLMs) to better understand and recognize gait. It proposes the α‑Gait model, which uses a Vocabulary Relation Mapper and a Gait Fine‑grained Detector to align vocabulary prompts with gait features, addressing the challenge of heterogeneous embedding spaces. Experiments on multiple gait datasets demonstrate the potential of incorporating VLM‑derived vocabulary information into gait recognition.

By Panjian Huang, Saihui Hou, Chunshui Cao, Xu Liu, Yongzhen Huang
arXiv Computer Vision
Aug 26

Representation Learning in Diffusion and Flow-based Model: An Application Aspect

The article surveys how diffusion and flow-based generative models learn rich visual representations and how these representations can be used to improve generation and other perception tasks. It introduces a three-tier framework that categorizes work into improving generative quality via representation learning, extracting representations for perception, and developing unified applications. The survey covers downstream tasks such as image classification, dense prediction, instance-level perception, and annotation-scarce scenarios, offering a taxonomy and highlighting future research directions.

By Yanchen Xu, Sida Huang, Zhenyu Gu, Ruishu Zhu, Yilan Gao, Hongyuan Zhang
arXiv Machine Learning
Oct 15

Modeling and Understanding Neural Weights of Humanoid Policies with Diffusion

The paper presents a latent diffusion framework that models the distribution of neural network weights for humanoid control policies. By compressing actor network parameters with a linear autoencoder and modeling the latent space with a Diffusion Transformer, the authors generate deployable networks that perform real‑world motions such as walking, dancing, and spin kicks on the Unitree G1 robot. The study also reveals a structural principle in the first‑layer weights that reflects the robot’s kinematic prior, appearing consistently across both reinforcement and imitation learning training methods.

By Huixuan Cheng, Bike Zhang, Shankar Sastry, Koushil Sreenath
Hugging Face Trending Papers
Jul 14

Differentiable Clone-Structured Causal Graphs for End-to-End Cognitive Map Learning from Image Sequences

How can an agent build a structured map of its world from nothing but an ongoing sequence of raw sensory input and its own movements, especially when natural variation means exact sensory patterns rarely repeat? The Clone-Structured Causal Graph algorithm (CSCG), a normative hippocampus model, shows how an interpretable map can be learned from aliased observations.

arXiv Machine Learning
Jul 15

Differentiable Clone-Structured Causal Graphs for End-to-End Cognitive Map Learning from Image Sequences

arXiv:2607. 12382v1 Announce Type: new Abstract: How can an agent build a structured map of its world from nothing but an ongoing sequence of raw sensory input and its own movements, especially when natural variation means exact sensory patterns rarely repeat?

By Arash Nikzad, Sasan Sarbishegi, Ali Dasmeh, Muhammad Asif, Parsa Gharavi, Erik Husom, Sagar Sen, Andrew B. Lehr, Olivier Penacchio, Ana Clemente, Tristan M. St\"ober
arXiv Computer Vision
Aug 28

Who Remains, What Changes: Identity Anchored Composed Gait Retrieval

The paper introduces Composed Gait Retrieval (CoGR), a task that retrieves a target gait sequence using a reference sequence and a natural language modification query. To support this, the authors create the first gait-language datasets—Language‑Augmented CCPG and Language‑Augmented CASIA‑B—via an automated annotation pipeline powered by large vision‑language models. They propose ComposeGait, an identity‑anchored composition framework with a Part‑aware Identity Adapter that injects identity tokens into a shared Q‑Former, achieving state‑of‑the‑art retrieval performance on both benchmarks.

By Jingchen Fei, Zengbin Wang, Yukun Liu, Muyi Sun, Shibiao Xu, Man Zhang
arXiv AI
Sep 15

Diffusion-Based Generation of Gait Trajectories

The paper presents a method for generating lower‑limb joint‑angle gait trajectories using conditional diffusion models. It compares a baseline transformer diffusion model with a controllable diffusion transformer that includes adaptive normalization and classifier‑free guidance. Experiments on 4,590 gait cycles demonstrate that these diffusion models can produce realistic, periodic gait patterns while allowing some control over gait characteristics such as step length.

By Damian Benasco, Juan Carballeira-Lopez, Jaime Ramos-Rojas, Julio S. Lora-Millan, Antonio J. Del-Ama, David Rodriguez-Cianca, Pablo Lanillos
arXiv Computer Vision
Sep 17

Occluded Gait Recognition with Mixture of Experts: An Action Detection Perspective

The paper introduces GaitMoE, an action‑detection based mixture‑of‑experts framework for occluded gait recognition, leveraging temporal and action experts to infer missing body parts from adjacent frames and gait cycles. It also presents a new Occluded Gait database (OccGait) with diverse occlusion scenarios and annotations, and demonstrates superior performance on OccGait, OccCASIA‑B, Gait3D, and GREW datasets.

By Panjian Huang, Yunjie Peng, Saihui Hou, Chunshui Cao, Xu Liu, Zhiqiang He, Yongzhen Huang