arXiv Computation and Language

IchthyoNoma: Nomenclature and Context Sensitivity of Zero-Shot Biological Vision--Language Models for Bangladeshi Freshwater Fish Recognition

The paper audits zero‑shot vision‑language models—CLIP, BioCLIP, BioCLIP2, and a multilingual Jina CLIP v2—on 10,321 images of seven Bangladeshi freshwater fish species. BioCLIP2 achieves the highest accuracy (72.36% on BFF‑15 with English common names and 68.91% on SylFishBD with scientific names), while generic CLIP lags far behind (25.15% and 14.40%). The study also shows that Bengali prompts perform poorly, that Jina CLIP partially improves Bengali discrimination, and that image context (blur, masking) affects performance differently across species.

arXiv AI
Sep 12

Can Edge-Deployable Vision-Language Models Identify Species?

arXiv:2609. 11916v1 Announce Type: new Abstract: Camera traps often run in the field on edge hardware with limited or no connectivity, making small, locally-deployable vision-language models (VLMs) -- not frontier-scale ones -- the practically relevant class to evaluate for species identification.

By William Zhou, Mayukha Siripuram, Xiao Yan, Ziqi Liu, Yi Ding
arXiv Machine Learning
Aug 20

You Are What You Prompt: Prompt Quality, Domain Shift, and Uncertainty in Agrifood Vision-Language Models

The paper studies how prompt quality affects vision‑language models in the agrifood domain. It evaluates Zero‑Shot Prompt Ensembling (ZPE) on CLIP and SigLIP across four datasets, showing that ZPE offers limited gains on in‑distribution data but significantly improves accuracy and calibration when the domain shifts. The authors also introduce Prompt‑based Inconsistency Detection (PID), which uses prompt disagreement to detect failures under severe domain shift, outperforming standard confidence measures.

By Andrea Morales-Garz\'on, Salvador L\'opez-Joya, Miguel L\'opez-P\'erez, Maria J. Martin-Bautista
arXiv AI
Aug 14

The Role of Natural Language Understanding in Multimodal Video-Based Dengue Diagnosis

arXiv:2608. 12677v1 Announce Type: new Abstract: Detecting infection-related behavioral changes in mosquitoes from video data is challenging because mosquitoes are small, move rapidly and irregularly, and are affected by environmental factors such as background, lighting, and shadows, which can make reliable feature extraction difficult.

By Danial Sharifrazi, Saadat Behzadi, Julakha Jahan Jui, Mojtaba Mohammadi, Nouman Javed, Roohallah Alizadehsani, Prasad N. Paradkar, Asim Bhatti
arXiv AI
Aug 5

OliveGemma: A 3 Billion Visual Language Model for Recognising the Mediterranean & European Diet

arXiv:2608. 03428v1 Announce Type: cross Abstract: Image based dietary assessment offers a scalable alternative to self reported food diaries, yet fine-grained food recognition remains challenging due to high intra-class variability and visually similar dishes.

By Dimitrios I. Zaridis, Traianos Tsiokris, Vasileios C. Pezoulas, Daphni Plati, Eugenia Mylona, Eleni Georga, Nikos Tsiknakis, Antonis Sakellarios, Dimitrios I. Fotiadis