Rigel: Self-Distilled Score Adaptation for Image and Video Captioning Evaluation

Automatic evaluation of image and video captioning is essential for benchmarking multimodal systems, although standard evaluation metrics show limited alignment with human judgments. Recent approaches using large language models (LLMs), commonly referred to as LLM-as-a-Judge, have improved alignment with human judgments but still suffer from a mismatch between large-vocabulary language modeling and evaluation over a small label set.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

• llms
• multimodal
• benchmarks
• safety