The paper introduces EyeControl, an intent-driven image retouching agent that enhances visual focus by guiding attention to a target region with minimal user input. It combines a multi‑modal large language model to interpret user intent and a diffusion‑based retouching executor that aligns its attention map with a pseudo‑intent map, while an operation‑consistency constraint ensures natural global and local adjustments. The authors also present ControlArt‑Bench, a dataset for evaluating visual focus enhancement, and demonstrate that EyeControl achieves perceptually appealing results with stronger intent alignment.
arXiv:2606. 02735v1 Announce Type: cross Abstract: Generalization remains a central bottleneck for vision-language-action (VLA) models: under distractors, appearance shifts, and semantically similar tasks, the policy must often infer local execution details from coarse instructions while also deciding which parts of the image matter for control.
Gaze Attention is a new mechanism for multimodal large language models that selectively focuses on relevant visual regions during each generation step, rather than attending to all visual tokens. By grouping tokens into spatial regions and using learnable context tokens to retain global information, it reduces attention computation and visual key‑value entries by up to 90%. Experiments on 13 image and 6 video benchmarks show that Gaze Attention matches or outperforms dense‑attention baselines while using fewer visual resources.
arXiv:2605. 20950v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) face a bottleneck of prohibitive computational costs arising from massive visual token sequences during inference.
arXiv:2507. 15833v3 Announce Type: replace-cross Abstract: Human vision is a highly active process driven by gaze, which directs attention to task-relevant regions through foveation, dramatically reducing visual processing.
arXiv:2509. 06461v3 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) have demonstrated remarkable success across diverse visual tasks, yet their performance degrades in complex visual environments.
arXiv:2610.23297v1 Announce Type: cross Abstract: Single-image refocusing changes the focal plane and depth of field of a photograph after capture. It is inherently interactive: users try many focal...
OpenVAM is a new framework for visual attention modeling that combines a dense saliency map with language‑based explanations. It uses a decoupled design: a visual pathway for precise localization and a vision‑language head that generates grounded what/why explanations. The method is trained in three stages to preserve localization while adding language grounding, and a scalable pipeline creates multi‑domain annotations for evaluation.
arXiv:2606. 08016v1 Announce Type: cross Abstract: Current image editing software often hinges on fixed filters or expert tuning, leaving a gap between amateur users' intent and outcomes.
arXiv:2607.18227v2 Announce Type: replace Abstract: In line with the prevailing direction of vision research, we explore the integration of both generation and editing capabilities for video and imag...
arXiv:2606. 14703v1 Announce Type: cross Abstract: How a vision-language model internally solves the task of describing an image is far from obvious.
T3R is a training‑free, two‑stage token refinement framework designed to improve the efficiency and robustness of Vision‑Language‑Action (VLA) models. The first stage uses segmentation‑guided pruning to remove irrelevant visual patches, while the second stage applies saliency‑guided attention biasing to focus on action‑critical regions and language cues. Experiments on LIBERO‑Spatial, LIBERO, SIMPLER, and RoboTwin show that T3R can eliminate 85% of visual tokens with minimal loss in success rate and even improve performance under distribution shifts, achieving up to a 3.3× speedup in large‑scale settings.
The paper investigates how different visual representations and integration mechanisms affect the performance of World Action Models (WAMs). It finds that strong general‑purpose visual representations yield the largest robustness gains, that channel‑wise joint prediction is the most effective integration strategy, and that additional sources should be chosen based on the unique task‑relevant information they provide. Using these insights, the authors propose R$^2$‑WAM, which achieves state‑of‑the‑art success rates on RoboCasa GR1 Tabletop and RoboTwin 2.0.