arXiv Computer Vision

AVAtt: A Free-Viewing Eye-Tracking Dataset and Benchmark for Visual Attention on Paintings

AVAtt is a free‑viewing eye‑tracking dataset comprising Images{} paintings from sixteen art movements and five centuries, with Scanpaths{} scanpaths and Fixations{} fixations collected from Participants{} participants. The dataset provides individual scanpaths, fixation timing, eye‑screen distance, fixation and saliency maps, temporal saliency videos, and rich art metadata. A benchmark of classic and deep saliency models shows significant room for improvement, and 44 scanpath‑similarity measures—including a new language‑free image‑encoder family—are ranked.

arXiv Computer Vision
Oct 5

Moving Forward with Video Saliency: A New Dataset and Benchmark where Motion Matters

The paper introduces SalTempto, a new video saliency benchmark featuring 224 highly dynamic clips from HACS‑Segments, each with event context and gaze data from up to 16 subjects. It shows that static baselines perform poorly on SalTempto compared to LEDOV, while fine‑tuned temporal models achieve significant gains, yet still leave a large portion of explainable gaze information unaccounted for. The dataset highlights the need for better temporal modeling in video saliency research.

By Susmit Agrawal, Rebecca Wanner, Juliane Verwiebe, Matthias Tangemann, Matthias Bethge, Matthias K\"ummerer
arXiv Computer Vision
Oct 19

GazeCLIP: Gaze-Guided CLIP with Adaptive-Enhanced Fine-Grained Language Prompt for Deepfake Attribution and Detection

The paper introduces GazeCLIP, a gaze‑guided CLIP framework that uses adaptive‑enhanced fine‑grained language prompts for deepfake attribution and detection (DFAD). It presents a new benchmark evaluating DFAD on novel generative methods such as diffusion and flow models, and proposes a gaze‑aware image encoder (GIE) that fuses gaze prompts with image embeddings to capture global forgery patterns. A language refinement encoder (LRE) further refines language embeddings for precise vision‑language matching, achieving state‑of‑the‑art performance with 6.56% higher accuracy and 5.32% higher AUC on the benchmark.

By Yaning Zhang, Linlin Shen, Zitong Yu, Chunjie Ma, Zan Gao
arXiv Computer Vision
Oct 1

GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction

GazeFlow is a new framework for egocentric gaze prediction that models gaze as a joint distribution of temporal positions conditioned on both top‑down task cues and bottom‑up visual saliency. It employs conditional flow matching to iteratively transform Gaussian noise into realistic gaze trajectories, using a velocity field informed by video‑encoded visual features and global task queries. On standard benchmarks, GazeFlow outperforms existing methods on per‑frame metrics and produces trajectories that better reflect human gaze dynamics.

By Sheng Zhao, Weikai Lin, Yuhao Zhu
arXiv Computer Vision
Oct 5

Gaze Attention: Query-Adaptive Visual Routing for Efficient Multimodal LLMs

Gaze Attention is a new mechanism for multimodal large language models that selectively focuses on relevant visual regions during each generation step, rather than attending to all visual tokens. By grouping tokens into spatial regions and using learnable context tokens to retain global information, it reduces attention computation and visual key‑value entries by up to 90%. Experiments on 13 image and 6 video benchmarks show that Gaze Attention matches or outperforms dense‑attention baselines while using fewer visual resources.

By Junha Song, Byeongho Heo, Geonmo Gu, Jaegul Choo, Dongyoon Han, Sangdoo Yun
arXiv Machine Learning
Oct 21

What Not to Erase: Saliency-Constrained Augmentation for Low-Resource Handwritten Character Recognition

The paper investigates saliency-guided data augmentation for low-resource handwritten character recognition, proposing that saliency maps can be used to design augmentation variants that perturb, preserve, or constrain visually informative regions. It introduces the Explainability Consistency Index (ECI) to measure saliency stability under perturbations and compares classical transformations, random lacunae, and saliency-constrained lacunae. Results show that saliency-constrained augmentation can improve recognition and explanation consistency, but the optimal strategy depends on architecture and corpus, suggesting saliency should be used as a control mechanism rather than a fixed augmentation rule.

By Paraskevi Platanou, John Pavlopoulos