Accelerating vision-language models with LFM2.5-VL-DSpark

Vision Language Models (Better, faster, stronger)

Accelerating Vision-Language Models: BridgeTower on Habana Gaudi2

Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models

Vision Language Models Explained

A Dive into Vision-Language Models

SmolVLM - small yet mighty Vision Language Model

Vision Language Model Alignment in TRL ⚡️

ParVL: Parallel Scaling and Expandable Compute Allocation for Multimodal LLMs

Existing scaling strategies for Multimodal Large Language Models (MLLMs) typically expand either model parameters or sequential inference computation, incurring substantial memory or latency overhead. More importantly, most existing methods fail to alter the rigid, fixed computation allocation between the Vision Transformer and the Large Language Model components, limiting task-specific optimization.

Databricks ❤️ Hugging Face: up to 40% faster training and tuning of Large Language Models

PRISM-VLM: A Multi-Axis Discriminative Benchmark for Compact Vision-Language Models

Compact vision-language models (VLMs) now power a growing share of multimodal applications. The benchmarks used to compare them, however, inherit a frontier-centric design: each model is reduced to a...

Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videos

arXiv:2501.04001v4 Announce Type: replace Abstract: This work presents Sa2VA, the first comprehensive, unified model for dense grounded understanding of both images and videos. Unlike existing multi-...

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community