arXiv Computer Vision September 11, 2026 By Pau de Jorge, C\'esar Roberto de Souza, Bj\"orn Michele, Mert B\"ulent Sar{\i}y{\i}ld{\i}z, Philippe Weinzaepfel, Florent Perronnin, Diane Larlus, Yannis Kalantidis

Task Alignment: A Simple Proxy for Practical Model Merging Across Diverse Vision Tasks

Read the original on arXiv Computer Vision →

The paper introduces the task alignment proxy, a method that accelerates hyperparameter selection for merging models fine‑tuned on diverse vision tasks. It addresses the challenge of training heterogeneous decoders, which makes traditional downstream performance evaluation costly. By using the proxy, the authors demonstrate that model merging can be applied efficiently to multi‑task vision models beyond CLIP‑based classification.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Machine Learning

Jul 31

Transporting Task Vectors across Different Architectures without Training

arXiv:2602. 12952v3 Announce Type: replace Abstract: Adapting large pre-trained models to downstream tasks often produces task-specific parameter updates that are expensive to relearn for every model variant.

By Filippo Rinaldi, Aniello Panariello, Giacomo Salici, Angelo Porrello, Simone Calderara

llms

arXiv AI

Jun 2

On the Limits of Token Reduction for Efficient Unified Vision Language Training

arXiv:2606. 01503v1 Announce Type: cross Abstract: Unified vision-language models (VLMs) integrate visual understanding and visual generation within a single autoregressive backbone, but their joint training is computationally expensive and largely overlooked from an efficiency perspective.

By Siyi Chen, Weiming Zhuang, Jingtao Li, Lingjuan Lv

llms multimodal

arXiv Machine Learning

Aug 10

Training-free Task Classification for Multi-Task Model Merging

arXiv:2606. 22589v2 Announce Type: replace Abstract: Ever since the advent of foundation models and the pre-training-finetuning paradigm, there have been numerous efforts to merge multiple task-specific experts into a single multi-task model.

By Jungyong Son, Jinwook Jung, Sungyong Baik

computer-vision nlp fine-tuning benchmarks

arXiv AI

1d ago

Model Specific Task Similarity for Vision Language Model Selection via Layer Conductance

The paper introduces a method for selecting the best vision‑language model for a downstream task by analyzing the internal dynamics of the visual encoder. It represents each task with layer‑wise conductance and uses an entropy‑regularized alignment to derive a target‑conditioned block importance distribution. The proposed Directional Conductance Divergence (DCD) metric captures asymmetric transferability, enabling accurate prediction of model rankings without direct inference, and achieves a 14.7% NDCG@5 improvement over SWAB on 48 VLMs across 21 datasets.

By Wei Yang, Hong Xie, Tao Tan, Xin Li, Defu Lian, Enhong Chen

llms multimodal benchmarks safety

arXiv AI

Jul 3

Navigating the Alignment-Calibration Trade-off: A Pareto-Superior Frontier via Model Merging

arXiv:2510. 17426v3 Announce Type: replace-cross Abstract: The "alignment tax" of post-training is typically framed as a drop in task accuracy.

By Tiancheng Hu, Benjamin Minixhofer, Nigel Collier

safety

arXiv Machine Learning

Aug 10

Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Models

arXiv:2608. 06901v1 Announce Type: cross Abstract: Vision-language models (VLMs) have achieved remarkable generalization across diverse multimodal tasks through large-scale pre-training, yet their rapidly increasing computational and memory requirements pose significant challenges for deployment in constrained environments.

By Minseok Kang, Hyunwoo Kim, Chanyoung Kim, Minwoo Kim, Jaekoo Lee, Dahuin Jung

llms efficiency multimodal

One email a morning, machine-written

Related stories

Transporting Task Vectors across Different Architectures without Training

On the Limits of Token Reduction for Efficient Unified Vision Language Training

Training-free Task Classification for Multi-Task Model Merging

Model Specific Task Similarity for Vision Language Model Selection via Layer Conductance

Navigating the Alignment-Calibration Trade-off: A Pareto-Superior Frontier via Model Merging

Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Models