arXiv Computer Vision

CFC26: Building Evaluations for Deployment in Sonar-Based Fish Counting

The paper introduces CFC26, an expanded fish‑counting dataset and evaluation framework designed to mimic real‑world sonar deployment scenarios. It extends the earlier CFC22 dataset to eleven locations across nine Pacific salmon rivers, adding new metrics (nMNE and nMANE) that align with expert workflows and uncover biases not seen with frame‑level detection. The authors demonstrate that these metrics reveal directional counting errors that could have ecological consequences.

arXiv Computer Vision
Oct 19

A Paired RGB-Sonar Dataset for Fish Monitoring with Consumer Sonar

The paper presents the Huntington and Caltech Koi RGB and Sonar dataset (HaCKRS), which pairs Garmin LiveScope imaging-sonar recordings with top‑down RGB video of koi carp. The dataset includes over 105,000 temporally matched frame pairs, spanning about 3.3 hours across four range and orientation configurations, along with detailed metadata, sonar geometry, synchronization data, and planar registration for three horizontal setups. The release focuses on paired observations and calibration to aid annotation and the development of fish detection, tracking, and counting methods, and to explore the use of consumer sonar for ecological monitoring.

By Mourad Derbedrosian, Michael Hobley, Pietro Perona
arXiv Computer Vision
Aug 24

WildFin: An In-the-Wild Dataset for Fish Behavioral Recognition

arXiv:2608.21281v1 Announce Type: new Abstract: Recent advances in field technology have led to a massive influx of in-the-wild video data for ecological science. The primary bottleneck in leveraging...

By Abigail G. Grassick, Jerome Tze-Hou Hsu, Ethan Lin, Ziang Liu, Max Whitton, Madelyn Hair, Liam Gutierrez, Haozheng Yu, Kristin Branson, Vivek Jayaraman, Michael A. Gil, Andrew M. Hein, Jennifer J. Sun
arXiv Computer Vision
Sep 7

PuTR-CouT: Counting-by-Tracking in Camera-Trap Image Sequences

PuTR-CouT is a transformer‑based counting‑by‑tracking framework designed for camera‑trap image sequences. It generates synthetic training data using structural priors to create pseudo‑tracking labels, enabling the tracker to associate detections across frames and estimate per‑species counts. The method improves upon the MaxBoxCount baseline on the iWildCam 2021 benchmark, offering competitive counting results along with multi‑species predictions and track‑level verification.

By Fagner Cunha, Juan G. Colonna, Eulanda M. dos Santos
arXiv AI
Jun 12

GetNetUPAM: Ecologically Informed Nested Cross-Validation and Noise-Robust Attention for Marine Bioacoustic Monitoring

arXiv:2509. 04682v2 Announce Type: replace-cross Abstract: Deploying reliable bioacoustic monitoring systems requires models that generalize under high-noise, low-SNR conditions and evaluation protocols that expose deployment-relevant failure modes, gaps largely unaddressed in current UPAM practice.

By Nicholas R. Rasmussen, Rodrigue Rizk, Longwei Wang, KC Santosh
arXiv Computer Vision
Sep 3

Efficient Passive Acoustic Monitoring of Killer Whales Using a Two-Stage Detection and Ecotype Classification Cascade

The paper presents a lightweight ResNet-based two-stage cascade for passive acoustic monitoring of killer whales. First, it detects vocalizations, then it classifies confident detections into five eastern North Pacific ecotypes, abstaining on ambiguous calls. The pipeline achieves high macro‑F1 scores on the DCLDE 2027 dataset and improves real‑time inference speed, while active learning adapts the detector to new acoustic environments.

By Daniela Ruiz, Manuel Castellote, Zhongqi Miao, Carl Chalmers, Bruno Demuro, Rahul Dodhia, Pablo Arbelaez, Juan M. Lavista
arXiv Computer Vision
Sep 4

Counting Animals in Camera-Traps Image Sequences without Count Labels: Winning Solution to the iWildCam 2021 Challenge

The paper presents MaxBoxCount, the winning solution to the iWildCam 2021 Challenge, which tackles counting animals in camera‑trap image sequences without using count labels. It combines a robust species classification pipeline with a counting heuristic based on MegaDetector detections to estimate the number of unique individuals across short image bursts. The method addresses challenges posed by temporal discontinuities and the high cost of manual count annotations.

By Fagner Cunha, Juan G. Colonna, Eulanda M. dos Santos
arXiv Machine Learning
Sep 15

Large-scale bioacoustic detection using semantic segmentation: a deep learning framework applied to fin whale calls in ocean-bottom seismometer recordings

arXiv:2609.13281v1 Announce Type: cross Abstract: Ocean-bottom seismometers (OBS), originally deployed for geophysical research, continuously record low-frequency sound for months to years across bro...

By Jocelyn Japnanto, Alex A. Saoulis, Miriam Romagosa, Rita Leit\~ao, Gabrielle Arrieta, M\'onica A. Silva, Matthew Graham, Ana M. G. Ferreira
arXiv Computer Vision
1d ago

Nereus: A Large-Scale Underwater Dataset for Fine-Grained Attribute Understanding and Grounded Counting Perception

Nereus is a new large-scale underwater dataset that supports fine-grained object attribute understanding and grounded counting perception. It contains 88,000 images, 2.68 million question-answer pairs, and annotations for 136,000 marine organism objects spanning 2,690 species and 1,515 genera, along with 65,000 point annotations and 67,000 grounded counting QA pairs. Experiments with multimodal models show that Nereus improves downstream adaptation over existing underwater-domain data and provides a foundation for future research on fine-grained marine perception.

By Jingtao Deng, Zihao Jin, Yuehe Chen, Feixiang He, Shuiwang Li, Dan Zeng
arXiv Machine Learning
Sep 24

Active Learning for Biodiversity Monitoring: From Label Efficiency to Reliable Ecological Inference

The paper discusses how active learning (AL) can alleviate the expert annotation bottleneck in biodiversity monitoring by selecting the most informative samples under a fixed budget. It highlights that while AL reduces labeling effort, its non-random sample selection complicates model validation, calibration, and ecological inference, issues often overlooked in current studies. The authors review existing AL research across acoustic and image data, identify gaps such as limited species coverage and lack of real-world deployments, and propose a tutorial framework and roadmap for developing AL methods that support efficient training, reliable validation, and trustworthy ecological conclusions.

By Ben McEwen, Shiqi Zhang, Dan Stowell