arXiv Computer Vision
How (Mis)calibrated is your Federated CLIP and what to do about it?
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
2d ago
Not All Layers Need Tuning: Diagnosing and Directing Adaptation in Vision-Language-Action Models
arXiv:2609.18084v1 Announce Type: cross Abstract: Fine-tuning a Vision-Language-Action (VLA) model for a new deployment environment is expensive, yet most methods apply uniform-capacity adapters to e...
arXiv Computer Vision
Aug 28
MVC-Bench: Benchmarking Calibration of Medical Vision-Language Models
MVC-Bench is a new benchmark designed to evaluate the calibration of vision‑language models (VLMs) and medical VLMs (Medical‑VLMs) for medical image classification. It tests calibration across robustness to modality, backbone, and domain shift; effectiveness of calibration strategies and prompt‑tuning methods; and stability under prompt‑template and random‑seed variations. The benchmark includes eight backbones, three medical modalities (fundus imaging, histopathology, chest X‑ray), and compares post‑hoc, train‑time, and zero‑shot calibration approaches, reporting accuracy, Expected Calibration Error (ECE), Maximum Calibration Error (MCE), and Adaptive Calibration Error (ACE) over 1,638 experiments, while also proposing a Multi‑Class Margin (MCM) regularization technique that improves ECE in most settings.
arXiv Machine Learning
Jul 28
Shift-Aware Calibration for Fine-Tuned CLIP: Leveraging Image-Text Alignment
arXiv:2501. 19060v4 Announce Type: replace-cross Abstract: Vision-language models (VLMs), such as CLIP, adapt effectively to downstream tasks through prompt tuning, but fine-tuning can misalign predictive confidence and accuracy, particularly on unseen classes.
arXiv Computer Vision
Sep 7
Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents
The paper introduces a Vision‑Language Model (VLM) that acts as a diagnostic agent to adapt a detect‑to‑track system to new domains without target‑domain labels. By inspecting rendered tracking outputs, the VLM identifies failure modes and iteratively recommends parameter updates, recovering a significant portion of performance lost when transferring hyperparameters from a source domain. Experiments on MOT17→MOT20 show the VLM tuner restores 67.8% of the lost headroom, while Bayesian optimization with proxy objectives performs poorly under large domain shifts.
arXiv Machine Learning
Jun 30
The Calibrated Deepfake Trust Score (CDTS): Competence-Coupled Trust Degradation Across Deepfake Detectors
arXiv:2606. 29484v1 Announce Type: cross Abstract: Modern deepfake detectors are rarely consumed as bare classifiers.
arXiv Machine Learning
Sep 2
Post-Training Science for Supervised Fine-Tuning
arXiv:2609.01244v1 Announce Type: new Abstract: Every supervised fine-tuning run forces the same chain of decisions, such as learning rate, batch size, LoRA or full fine-tuning, how many epochs, whic...