arXiv Computer Vision

GorillaWatch: An Automated System for In-the-Wild Gorilla Re-Identification and Population Monitoring

Hugging Face Trending Papers
Aug 5

Promptable Animal Pose Tracking Across Species

Animal pose estimation and tracking is important for wildlife monitoring and conservation research, and with limited expert time for labelling automated approaches are imperative. While human pose estimation and tracking has seen rapid progress thanks to large annotated datasets, animal pose remain challenging, due to large morphological and behavioural differences between species and limited annotated data.

arXiv Computer Vision
Sep 7

PuTR-CouT: Counting-by-Tracking in Camera-Trap Image Sequences

PuTR-CouT is a transformer‑based counting‑by‑tracking framework designed for camera‑trap image sequences. It generates synthetic training data using structural priors to create pseudo‑tracking labels, enabling the tracker to associate detections across frames and estimate per‑species counts. The method improves upon the MaxBoxCount baseline on the iWildCam 2021 benchmark, offering competitive counting results along with multi‑species predictions and track‑level verification.

By Fagner Cunha, Juan G. Colonna, Eulanda M. dos Santos
arXiv Computer Vision
Sep 4

Counting Animals in Camera-Traps Image Sequences without Count Labels: Winning Solution to the iWildCam 2021 Challenge

The paper presents MaxBoxCount, the winning solution to the iWildCam 2021 Challenge, which tackles counting animals in camera‑trap image sequences without using count labels. It combines a robust species classification pipeline with a counting heuristic based on MegaDetector detections to estimate the number of unique individuals across short image bursts. The method addresses challenges posed by temporal discontinuities and the high cost of manual count annotations.

By Fagner Cunha, Juan G. Colonna, Eulanda M. dos Santos
Hugging Face Trending Papers
Sep 28

VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking

VastMAT is a large‑scale multi‑animal tracking benchmark featuring 2,947 videos, 337 animal categories, and over 3.6 million bounding boxes with 22,883 identity trajectories. It emphasizes high‑quality, expert‑reviewed annotations and introduces Seen‑category and Unseen‑category evaluation protocols, revealing significant challenges in tracking unseen animals. The authors also propose a lightweight Center‑Distance‑Augmented Association module that boosts HOTA scores for existing MOT methods without extra training.

arXiv Computer Vision
Oct 12

Advancing Wildlife Conservation through Multimodal Animal Re-Identification with Environmental Metadata

The paper introduces MetaWild, a multimodal animal re-identification dataset that pairs 20,890 images from six species with environmental metadata such as temperature and circadian rhythms. It also proposes the Meta-Feature Adapter (MFA), a lightweight module that integrates this metadata into vision-language models for re-identification tasks. Experiments demonstrate that adding MFA consistently improves re-identification performance over visual-only baselines.

By Yuzhuo Li, Di Zhao, Tingrui Qiao, Yihao Wu, Bo Pang, Yun Sing Koh
arXiv AI
Sep 10

What Does Animal Re-Identification Learn? Linear Biological Concepts and Their Origins in Visual Representations

The study investigates whether Vision Transformer (ViT)-based animal re-identification models learn biologically meaningful concepts. Using a DINOv3 backbone fine‑tuned on Western lowland gorilla images, the authors find that sex and age emerge as linear directions in the model’s representations, generalizing to unseen individuals with high AUROC scores. They demonstrate that the sex direction is causally used by the model, that fine‑tuning relocates these concepts within the network, and that the representations reflect a graded biological axis encoded redundantly across the population.

By Robert Nolting, Alexandra Schild, Moritz Weckbecker, Maximilian Schall, Gerard de Melo
arXiv Computer Vision
Oct 22

MS2CAST: A Video Anomaly Detection Framework via Multi-Scale Spatial Cross-Attention and Efficient Spatiotemporal Networks

MS2CAST is a semi‑supervised video anomaly detection framework that fuses multi‑scale cross‑attention between a vision transformer (MViTv2‑S) and a CNN (ConvNeXt‑T) for spatial encoding, and replaces optical flow with two interchangeable spatiotemporal modules—SwinLSTM and VMRNN—operating in latent space. The training objective combines L1 loss, Gradient Difference Loss, and Multi‑Scale SSIM to enforce pixel‑level accuracy, sharpness, and structural fidelity. Experiments on UCSD Ped2, CUHK Avenue, and ShanghaiTech show competitive ROC‑AUC scores while using less than 1 GB of GPU memory.

By Ali Safaei, Mohammad Kazemi