arXiv Computer Vision September 7, 2026 By Daniel Davila, Ravikumar Balakrishnan, Mike Cochran

Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents

Read the original on arXiv Computer Vision →

The paper introduces a Vision‑Language Model (VLM) that acts as a diagnostic agent to adapt a detect‑to‑track system to new domains without target‑domain labels. By inspecting rendered tracking outputs, the VLM identifies failure modes and iteratively recommends parameter updates, recovering a significant portion of performance lost when transferring hyperparameters from a source domain. Experiments on MOT17→MOT20 show the VLM tuner restores 67.8% of the lost headroom, while Bayesian optimization with proxy objectives performs poorly under large domain shifts.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI

Oct 21

VLA-Retain: Benchmarking Cross-Dimension Effects of Vision Tuning in VLAs

arXiv:2610.27698v1 Announce Type: cross Abstract: Vision-language-action (VLA) models transfer knowledge from large-scale pretraining into robot control, but their manipulation performance remains se...

By Borui Xu, Han Chen, Bingsheng He, Ming Wu, Jason Zeng, Michael Heinrich

robotics fine-tuning multimodal benchmarks

arXiv Machine Learning

Sep 17

Not All Layers Need Tuning: Diagnosing and Directing Adaptation in Vision-Language-Action Models

arXiv:2609.18084v1 Announce Type: cross Abstract: Fine-tuning a Vision-Language-Action (VLA) model for a new deployment environment is expensive, yet most methods apply uniform-capacity adapters to e...

By Shahram Najam Syed, Arthur Jakobsson, Prayuj Sachdev, Jeffrey Ichnowski

fine-tuning multimodal safety

arXiv Computer Vision

Sep 10

How (Mis)calibrated is your Federated CLIP and what to do about it?

arXiv:2512.04305v3 Announce Type: replace Abstract: Vision-language models (VLMs) such as CLIP are increasingly adapted across decentralized data silos, yet the reliability of their predictions under...

By Mainak Singha, Masih Aminbeidokhti, Paolo Casari, Gianni Franchi, Elisa Ricci, Subhankar Roy

llms fine-tuning multimodal

arXiv Computer Vision

Oct 19

CatchUp: Depth-Aware Re-Admission of Visual Tokens for Efficient Large Vision-Language Models

CatchUp is a training‑free framework that improves efficiency in large vision‑language models by depth‑aware re‑admission of visual tokens. It repeatedly evaluates query‑conditioned relevance, processes only selected tokens per decoder interval, and preserves deferred tokens for later re‑admission, using reference‑to‑current transition signals to approximate missed representation evolution. Experiments on three referring‑expression grounding datasets and six multimodal benchmarks show that CatchUp retains over 92% of full‑model performance with 88.9% fewer active tokens and reduces end‑to‑end latency by 8.0% at a 64‑token budget.

By Eunju Park, Uiwon Hwang

llms efficiency multimodal benchmarks

arXiv Computation and Language

Sep 30

From Routing Signals to Selective Review: Visual regrounding in MoE VLMs

arXiv:2609.38111v1 Announce Type: new Abstract: Vision-language models (VLMs) may accept false visual premises, answering questions about a target object's color, count, location, or state even when...

By Hongzhu Guo, Mohsen Fayyaz, Nanyun Peng

llms multimodal

arXiv Computation and Language

Sep 3

VTOS: Learning to Orchestrate Vision Tools by Co-Searching Solutions and Observers

VTOS (Vision Tools Orchestration Search) is a framework that adaptively orchestrates vision foundation tools—such as open‑vocabulary detectors, segmentation models, and post‑processing operators—by jointly searching for executable solution programs and observer programs that diagnose failures and provide feedback. The observer programs feed observations into a shared VisionThoughts knowledge base, guiding subsequent searches. In two case studies—dense object counting on LVIS‑Count and zero‑shot plant‑disease segmentation on PlantSeg‑OOD—VTOS outperforms static tool pipelines and agentic visual‑programming baselines, especially in complex scenarios like dense, occluded scenes and out‑of‑distribution segmentation.

By Jinchao Ge, Lingqiao Liu, Shuwen Zhao, Lei Wang

rag agents computer-vision