arXiv Machine Learning
Aug 19

Leveraging existing sparse point annotations for benthic imagery dense segmentation

The paper presents a method that leverages sparse expert point annotations from historical benthic surveys to improve dense segmentation of marine imagery. By using these points as visual prompts for the SAM2 foundation model and introducing a mechanism to filter out unreliable points, the authors generate high‑quality pseudo‑ground‑truth masks that train more accurate fine‑grained semantic segmentation models. The approach is validated on public benthic datasets and a new benchmark featuring real‑world sparse annotations, aiming to enable scalable ecological analysis.

By Cesar Borja, Breck A. McCollum, Jarret E. Byrnes, Kenneth Sebens, Ana C. Murillo
arXiv Computer Vision
4d ago

CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs

CoralscapesV2 is an expanded dataset for coral reef visual scene understanding, increasing the number of fine‑grained classes from 39 to 95 and adding 65,000 exhaustive fish instance masks. It supports panoptic segmentation by providing high‑quality semantic and instance labels across diverse, unconstrained reef imagery. The dataset serves as a challenging benchmark for modern segmentation models and enables broader applications such as benthic cover mapping and automated fish‑reef interaction analysis.

By Jonathan Sauder, Thomas Ruckli, Gabriel\.e Strodomskyt\.e, Ibrahim Souleiman Abdallah, Rahma Hassan Abdi, Djama Goumaneh Awaleh, Mohamed Houssein Farah, Moustapha Nour, Osama Sharhubil Saad, Mustafa Mohammed Khalafallah Altaib, Maysoon Kteifan, Farah Alsoqi, Eyad Zgool, Jafar Al-Omari, Temesgen Gebremeskel Gebreluel, Zekaria Zekeria Abdulkerim, Meron Ghirmay, Teklehaimanot Beraki, Devis Tuia, Guilhem Banc-Prandi
Hugging Face Trending Papers
Aug 19

Teach a Molmo2Fish: Towards interactive fish tracking with natural language guidance

The paper introduces Molmo2Fish, an interactive tool that uses a multimodal large language model to correct imperfect fish tracking predictions in sonar datasets. It demonstrates that the system can effectively improve multi‑object tracking performance through natural language guidance, though further enhancements are needed. The authors provide open‑source code and data for replication.

arXiv Computer Vision
Sep 7

PuTR-CouT: Counting-by-Tracking in Camera-Trap Image Sequences

PuTR-CouT is a transformer‑based counting‑by‑tracking framework designed for camera‑trap image sequences. It generates synthetic training data using structural priors to create pseudo‑tracking labels, enabling the tracker to associate detections across frames and estimate per‑species counts. The method improves upon the MaxBoxCount baseline on the iWildCam 2021 benchmark, offering competitive counting results along with multi‑species predictions and track‑level verification.

By Fagner Cunha, Juan G. Colonna, Eulanda M. dos Santos