arXiv Computer Vision

DeepSTEP: Simultaneous Tracking and Estimation of Pose for Animals and Humans

Hugging Face Trending Papers
Aug 5

Promptable Animal Pose Tracking Across Species

Animal pose estimation and tracking is important for wildlife monitoring and conservation research, and with limited expert time for labelling automated approaches are imperative. While human pose estimation and tracking has seen rapid progress thanks to large annotated datasets, animal pose remain challenging, due to large morphological and behavioural differences between species and limited annotated data.

arXiv Computer Vision
Sep 15

GorillaWatch: An Automated System for In-the-Wild Gorilla Re-Identification and Population Monitoring

arXiv:2512.07776v2 Announce Type: replace Abstract: Monitoring critically endangered western lowland gorillas is currently hampered by the immense manual effort required to re-identify individuals fr...

By Maximilian Schall, Felix Leonard Kn\"ofel, Noah Elias K\"onig, Jan Jonas Kubeler, Maximilian von Klinski, Joan Wilhelm Linnemann, Xiaoshi Liu, Iven Jelle Schlegelmilch, Ole Woyciniuk, Alexandra Schild, Dante Wasmuht, Magdalena Bermejo Espinet, German Illera Basas, Gerard de Melo
Hugging Face Trending Papers
Sep 28

VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking

VastMAT is a large‑scale multi‑animal tracking benchmark featuring 2,947 videos, 337 animal categories, and over 3.6 million bounding boxes with 22,883 identity trajectories. It emphasizes high‑quality, expert‑reviewed annotations and introduces Seen‑category and Unseen‑category evaluation protocols, revealing significant challenges in tracking unseen animals. The authors also propose a lightweight Center‑Distance‑Augmented Association module that boosts HOTA scores for existing MOT methods without extra training.

arXiv Computer Vision
Oct 22

SDPose: Exploiting Diffusion Priors for Out-of-Domain and Robust Pose Estimation

SDPose leverages pre‑trained diffusion models, specifically the Stable Diffusion U‑Net, to extract robust latent features for human pose estimation. By identifying the most effective upsampling levels, fusing these features with a lightweight aggregation module, and jointly training with keypoint heatmap supervision and a latent reconstruction loss, SDPose achieves strong cross‑domain generalization. The authors introduce the COCO‑OOD benchmark, comprising style‑transferred and corrupted subsets, to evaluate robustness, and demonstrate that SDPose matches Sapiens on COCO while outperforming competitors in zero‑shot cross‑domain scenarios.

By Shuang Liang, Jing He, Lejun Liao, Chuanmeizhi Wang, Guo Zhang, Yingcong Chen, Yuan Yuan
arXiv Computer Vision
Oct 9

Accurate and Efficient Object Pose Estimation via the Aggregation of Diffusion Features

The paper introduces a new approach to 3D object pose estimation that leverages diffusion model features, such as those from Stable Diffusion, to improve performance on unseen objects. Three aggregation architectures—vanilla, nonlinear, and context‑aware—are proposed, with a confidence‑adaptive aggregation network that selectively uses discriminative features to balance speed and accuracy. The method achieves state‑of‑the‑art accuracy on unseen object benchmarks (97.7% vs. 93.5% on Unseen LM) and real‑time performance (68 FPS) while reducing computational cost.

By Tianfu Wang, Guosheng Hu, Hongguang Wang
arXiv Computer Vision
Sep 17

Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion

The paper presents a generative framework that estimates category-level 6D pose and 3D size of objects from a single RGB image, using score-based diffusion models to produce a multi-hypothesis pose distribution. It replaces costly likelihood pruning with a Mean Shift approach to isolate the mode as the final pose estimate, achieving state-of-the-art results on the REAL275 benchmark. The method also decouples detection from pose estimation, enabling robust zero-shot generalisation on the Wild6D dataset and extending naturally to video sequences by propagating the pose distribution over time.

By Adam Bethell, Ravi Garg, Ian Reid
arXiv Computer Vision
Sep 15

MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons

arXiv:2604.28130v4 Announce Type: replace Abstract: Recent methods for arbitrary-skeleton motion capture from monocular video follow a factorized pipeline, where a Video-to-Pose network predicts join...

By Kehong Gong, Zhengyu Wen, Dao Thien Phong, Mingxi Xu, Weixia He, Qi Wang, Ning Zhang, Zhengyu Li, Guanli Hou, Dongze Lian, Xiaoyu He, Mingyuan Zhang, Hanwang Zhang
arXiv Computer Vision
Oct 5

MoSE3: Learning World-Space SE(3) at Every Pixel

MoSE3 is a feed‑forward model that predicts dense SE(3) motion—full 6‑DoF rigid transforms—at every pixel from monocular RGB video, providing rotation, translation, and grouping information simultaneously. It achieves this by jointly learning 3D point tracks and rigidity embeddings, then differentiably fitting transforms within soft rigid clusters. The authors also release Art‑Kubric, a large synthetic dataset with dense SE(3) and rigidity labels, and demonstrate state‑of‑the‑art performance on both rigid and articulated benchmarks, with strong generalization to real‑world videos.

By Jiahuan Cheng, Zhiyi Li, Tian Xia, Ruojin Cai, Yilun Du, Qianqian Wang