arXiv:2608.22926v1 Announce Type: new
Abstract: Gaze is increasingly used as an input signal for vision and multimodal models, yet no consensus exists on how to represent it across datasets. Raw trac...
By Virmarie Maquiling, Zhuojiang Cai, Enkelejda Kasneci
arXiv:2609.05522v1 Announce Type: cross
Abstract: Eye-tracking data are expensive to collect, requiring specialized hardware and controlled laboratory conditions, and difficult to share because of pr...
By Laxman Basnet, Alexander Szorkovszky, Pedro G. Lind, Anis Yazidi, Shailendra Bhandari
DiTGaze is a calibration‑efficient augmentation system for few‑shot gaze estimation that uses a two‑stream 3D Gaussian Splatting backbone and a geometry‑conditioned latent Diffusion Transformer. It bridges rasterized Gaussian features to latent tokens via a learnable projection and frozen VAE, and incorporates timestep, identity, and expression conditioning through Adaptive Layer Normalization. The method densifies gaze supervision with intermediate yaw‑pitch sampling and applies an orthogonality constraint to reduce interference among gaze, pose, and expression, achieving a 4.1 % reduction in generator‑level gaze error on ETH‑XGaze and outperforming baselines across all calibration budgets up to nine real images.
By Abiram Panchalingam, Indu P. Bodala, Stuart E. Middleton
arXiv:2603.26945v2 Announce Type: replace
Abstract: Appearance-based gaze estimation (AGE) has achieved remarkable performance in constrained settings, yet we reveal a significant generalization gap...
By Zhenhao Li, Zheng Liu, Seunghyun Lee, Amin Fadaeinejad, Yuanhao Yu
arXiv:2606. 25177v1 Announce Type: new Abstract: Cognitive workload monitoring is important for adaptive rehabilitation and assistive interfaces, where task difficulty, pacing, and feedback should be adjusted according to the user's cognitive state to avoid overload and under-challenge.
By Guorui Lu, Shaohua Guan, Zhen Xu, Qinyu Chen
The paper introduces GazeCLIP, a gaze‑guided CLIP framework that uses adaptive‑enhanced fine‑grained language prompts for deepfake attribution and detection (DFAD). It presents a new benchmark evaluating DFAD on novel generative methods such as diffusion and flow models, and proposes a gaze‑aware image encoder (GIE) that fuses gaze prompts with image embeddings to capture global forgery patterns. A language refinement encoder (LRE) further refines language embeddings for precise vision‑language matching, achieving state‑of‑the‑art performance with 6.56% higher accuracy and 5.32% higher AUC on the benchmark.
By Yaning Zhang, Linlin Shen, Zitong Yu, Chunjie Ma, Zan Gao
arXiv:2610.35414v1 Announce Type: new
Abstract: Photorealistic avatar videos decouple the appearance of a rendered face from the person who operates it, which makes conventional face recognition unsu...
By Katsuya Ogata, Ryoya Yoshiyama, Kawachi Hodaka, Yuta Nakashima
arXiv:2608. 03025v1 Announce Type: new Abstract: Multimodal named entity recognition (MNER) determines whether each candidate span and entity-type hypothesis is supported by joint textual and visual evidence.
By Feng Zhang, Feiyu Han, Rongxin Yang, Yang Liu, Yancheng Chen, Rui Wang, Yingguang Yang, Tian Xueyun, Chongyang Zhang, Hao Zheng, Xu Kefu, Congjing Ran, Fuhai Chen, Bin Chong
arXiv:2608. 03025v3 Announce Type: replace Abstract: Multimodal named entity recognition (MNER) determines whether each candidate span and entity-type hypothesis is supported by joint textual and visual evidence.
By Feng Zhang, Feiyu Han, Rongxin Yang, Yang Liu, Yancheng Chen, Rui Wang, Yingguang Yang, Tian Xueyun, Chongyang Zhang, Hao Zheng, Xu Kefu, Congjing Ran, Fuhai Chen, Bin Chong
AOI-Net introduces a structural face AOI-guided Eye‑Gaze Track Network that jointly models short‑term temporal dynamics and AOI‑level structural organization for Autism Spectrum Disorder detection. The network uses a gating mechanism to adaptively combine complementary representations and incorporates class‑distribution‑aware learning to address the imbalance between ASD and typically developing participants. Experiments on a large clinical eye‑tracking database with over 1,300 participants demonstrate that AOI‑Net outperforms state‑of‑the‑art methods and offers interpretable gaze‑behavior modeling for scalable AI‑driven ASD screening.
By Zhanpei Huang, Binbin Sun, Jialiang Chen, Yiou Wang, Taochen Chen, Yuzhu Ji, Yiqun Zhang, Yiu-Ming Cheung
arXiv:2606. 30035v1 Announce Type: cross Abstract: Free-viewing gaze data provides a rich, task-free window into human visual attention.
By Beryl Gnanaraj, Jaya Sreevalsan-Nair, Saqib Alam Ansari, Maanasa Rajaraman
arXiv:2608. 11367v1 Announce Type: cross Abstract: Estimating human gaze targets from images in-the-wild is an important and formidable task.
By Xu Cao, Houze Yang, Vipin Gunda, Zhongyi Zhou, Tianyu Xu, Adarsh Kowdle, Inki Kim, James M. Rehg