arXiv Computer Vision

FieldGuideRAG: Image-Grounded GraphRAG for Fine-Grained Recognition with Vision-Language Models

FieldGuideRAG is a training‑free GraphRAG approach that uses a frozen vision‑language model to recognize fine‑grained species by comparing a query image to photographs stored on each species node in a knowledge graph. The graph links species to relatives, geographic range, and ecological facts, and the system fuses verification scores with range edges to answer organism‑related questions. On datasets such as CUB‑200 and iNaturalist, FieldGuideRAG’s use of node photographs improves verification over species names, surpasses a SigLIP retriever by up to 16 points, and achieves up to 89.5% accuracy on ecological questions.

arXiv AI
Sep 12

Can Edge-Deployable Vision-Language Models Identify Species?

arXiv:2609. 11916v1 Announce Type: new Abstract: Camera traps often run in the field on edge hardware with limited or no connectivity, making small, locally-deployable vision-language models (VLMs) -- not frontier-scale ones -- the practically relevant class to evaluate for species identification.

By William Zhou, Mayukha Siripuram, Xiao Yan, Ziqi Liu, Yi Ding
arXiv Machine Learning
Sep 22

Vision Transformers versus convolutional neural networks for fine-grained orchid genus identification in a species-rich, data-poor flora: a controlled benchmark on the Orchidaceae of New Guinea

The study benchmarks Vision Transformers (ViTs) against convolutional neural networks (CNNs) for fine‑grained orchid genus identification in New Guinea’s species‑rich, data‑poor flora. Using a two‑stage system that first predicts genus and then retrieves similar species images, the authors fine‑tuned four pretrained backbones on 16,701 photographs from 120 genera and 1,350 species. The self‑supervised ViT DINOv2 achieved the highest genus accuracy (macro top‑1 66.9 %) and outperformed both CNNs and a domain‑matched pretrained ViT, demonstrating strong species retrieval and open‑set detection capabilities.

By Reza Saputra, Diah Harnoni Apriyanti, Andr\'e Schuiteman, Kurt Metzger, Ashley Field, Katharina Nargar, William Edwards
arXiv Computer Vision
Oct 12

Advancing Wildlife Conservation through Multimodal Animal Re-Identification with Environmental Metadata

The paper introduces MetaWild, a multimodal animal re-identification dataset that pairs 20,890 images from six species with environmental metadata such as temperature and circadian rhythms. It also proposes the Meta-Feature Adapter (MFA), a lightweight module that integrates this metadata into vision-language models for re-identification tasks. Experiments demonstrate that adding MFA consistently improves re-identification performance over visual-only baselines.

By Yuzhuo Li, Di Zhao, Tingrui Qiao, Yihao Wu, Bo Pang, Yun Sing Koh
Hugging Face Trending Papers
Aug 9

TomaMMU: A Comprehensive Multimodal Understanding Benchmark for Tomato Leaf Diseases

To address this gap, we introduce TomaMMU, a large-scale Tomato leaf disease MultiModal Understanding dataset, alongside TomaBench, a benchmark for evaluating VLMs on tomato disease understanding. TomaMMU comprises 28,808 high-quality images spanning 15 categories and 213,119 human-annotated visual question-answer pairs, generated through a three-stage pipeline comprising Data Collection, Human Annotation, and Question-Answer Generation.