Hugging Face Blog

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

arXiv AI
Sep 16

Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs

The paper reports a submission to the SHROOM-Visions shared task, aiming to detect and classify hallucinated character spans in vision‑language model outputs across four languages. The authors use multiple fine‑tuned vision‑language models as independent annotators, combine their predictions via character‑level majority voting, and also investigate activation probes. Their method achieved first place in three of the four languages and consistently ranked on the podium for all languages and metrics, with analysis showing that model disagreement mirrors human annotator disagreement.

By Toqeer Ehsan, Nico Penttil\"a, Richard Schmidt, Arash Hajikhani, Victoria Palacin