arXiv:2502.04192v5 Announce Type: replace Abstract: Multiple works have emerged to push the boundaries of multi-modal large language models (MLLMs) towards pixel-level understanding. The current tren...
arXiv:2608. 07886v1 Announce Type: cross Abstract: Vision-language grounding connects language to visual content, yet most existing formulations reduce grounding to a unidirectional localization problem: given a prespecified text phrase or category name, identify the corresponding image region.
arXiv:2604. 27720v2 Announce Type: replace Abstract: Vision-language models (VLMs) are increasingly applied to medical visual question answering (Med-VQA), yet whether they can \emph{localize} the evidence behind their answers---a prerequisite for clinical auditability---is poorly characterized.
arXiv:2610.32220v1 Announce Type: new Abstract: Autoregressive vision-language models (VLMs) struggle to ground generated text in the correct image regions, and existing explainability methods, such...
arXiv:2610.27211v1 Announce Type: new Abstract: Continual vision-language models (VLMs) encounter a stream of environments and must also reject inputs that do not belong to the environment at hand....
arXiv:2609.27076v1 Announce Type: new Abstract: Open-vocabulary visual grounding enables robots to localise task-relevant entities from natural-language queries without dependence on predefined perce...
The paper introduces Visual Retrieval Heads (VRHs), a small fraction of attention heads in vision‑language models that are causally responsible for grounding text descriptions to image regions. By recasting head‑scoring methods and evaluating across eleven VLMs and five benchmarks, the authors show that masking the top 20 VRHs can drop grounding accuracy by up to 80 percentage points, while random masking has little effect. VRHs generalize across various visual reference tasks, preserve output format while corrupting localization, and transfer causally across models sharing an LLM backbone.
GrabVG is a visual grounding framework for UAV imagery that tackles the challenges of small, densely packed, and visually similar objects by separating the task into preattentive hypothesis search and graph-attentive feature binding. It first generates a compact set of reliable object hypotheses using distillation-guided proposal induction and text-aware filtering, then constructs a sparse graph where language-guided visual cues and inter-instance topological relationships are jointly bound and propagated via graph attention. Experiments on AerialVG and AerialSense demonstrate that GrabVG achieves a strong accuracy–speed trade‑off, reaching 67.31% and 80.34% Acc@0.5 and outperforming baselines by 10.55 and 8.76 percentage points.
arXiv:2608.28216v1 Announce Type: new Abstract: Locating a specific object instance in a cluttered scene using a single reference image and a short description, and reporting when that instance is ab...
arXiv:2606. 06890v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) frequently rely on language priors, producing confident answers that are weakly grounded in visual evidence.
TempoGround is a vision‑language model–native framework for streaming visual grounding that detects cross‑frame object correspondence and explicitly models object presence states. It uses a curriculum prediction mechanism to resolve 2D instance association, predict object entry, continuation, or exit, decode 2D boxes, and lift them to 3D camera‑frame boxes. The approach is further refined with Streaming Grounding Reinforcement, which optimizes grounding, identity, and consistency rewards, and achieves significant improvements on multiple streaming visual grounding benchmarks.
GrabVG is a visual grounding framework for UAV imagery that tackles the challenges of small, densely packed, and visually similar objects. It splits the task into preattentive hypothesis search and graph‑attentive feature binding, using distillation‑guided proposals and a sparse graph to capture intra‑ and inter‑instance relationships. Experiments on AerialVG and AerialSense show that GrabVG achieves higher accuracy and speed, outperforming baselines by significant margins.