arXiv Computer Vision

EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis

EyeMakeYou is a multi‑conditional denoising diffusion model that synthesizes high‑frequency, subject‑specific gaze velocity sequences. It conditions on identity, task, and self‑reported subjective states (difficulty, mental tiredness, eye tiredness) to generate realistic 5‑second, 1000‑Hz bivariate gaze data from a reference trajectory. Experiments on the GazeBase dataset show that EyeMakeYou outperforms existing generative methods in spatial accuracy and real‑synthetic similarity while preserving task‑dependent associations with subjective reports.

arXiv Computer Vision
2d ago

DiTGaze: Geometry-Conditioned Diffusion Augmentation for Few-Shot Gaze Estimation

DiTGaze is a calibration‑efficient augmentation system for few‑shot gaze estimation that uses a two‑stream 3D Gaussian Splatting backbone and a geometry‑conditioned latent Diffusion Transformer. It bridges rasterized Gaussian features to latent tokens via a learnable projection and frozen VAE, and incorporates timestep, identity, and expression conditioning through Adaptive Layer Normalization. The method densifies gaze supervision with intermediate yaw‑pitch sampling and applies an orthogonality constraint to reduce interference among gaze, pose, and expression, achieving a 4.1 % reduction in generator‑level gaze error on ETH‑XGaze and outperforming baselines across all calibration budgets up to nine real images.

By Abiram Panchalingam, Indu P. Bodala, Stuart E. Middleton
arXiv Computer Vision
Oct 19

GazeCLIP: Gaze-Guided CLIP with Adaptive-Enhanced Fine-Grained Language Prompt for Deepfake Attribution and Detection

The paper introduces GazeCLIP, a gaze‑guided CLIP framework that uses adaptive‑enhanced fine‑grained language prompts for deepfake attribution and detection (DFAD). It presents a new benchmark evaluating DFAD on novel generative methods such as diffusion and flow models, and proposes a gaze‑aware image encoder (GIE) that fuses gaze prompts with image embeddings to capture global forgery patterns. A language refinement encoder (LRE) further refines language embeddings for precise vision‑language matching, achieving state‑of‑the‑art performance with 6.56% higher accuracy and 5.32% higher AUC on the benchmark.

By Yaning Zhang, Linlin Shen, Zitong Yu, Chunjie Ma, Zan Gao
arXiv AI
Aug 5

DiffImaginE: Imagine to Verify Entity Types with Diffusio

arXiv:2608. 03025v1 Announce Type: new Abstract: Multimodal named entity recognition (MNER) determines whether each candidate span and entity-type hypothesis is supported by joint textual and visual evidence.

By Feng Zhang, Feiyu Han, Rongxin Yang, Yang Liu, Yancheng Chen, Rui Wang, Yingguang Yang, Tian Xueyun, Chongyang Zhang, Hao Zheng, Xu Kefu, Congjing Ran, Fuhai Chen, Bin Chong
arXiv AI
Aug 14

DiffImaginE: Imagine to Verify Entity Types with Diffusion

arXiv:2608. 03025v3 Announce Type: replace Abstract: Multimodal named entity recognition (MNER) determines whether each candidate span and entity-type hypothesis is supported by joint textual and visual evidence.

By Feng Zhang, Feiyu Han, Rongxin Yang, Yang Liu, Yancheng Chen, Rui Wang, Yingguang Yang, Tian Xueyun, Chongyang Zhang, Hao Zheng, Xu Kefu, Congjing Ran, Fuhai Chen, Bin Chong
arXiv AI
Sep 1

AOI-Net: Structural Face AOI-Guided Eye-Gaze Track Representation Learning for Autism Spectrum Disorder Detection

AOI-Net introduces a structural face AOI-guided Eye‑Gaze Track Network that jointly models short‑term temporal dynamics and AOI‑level structural organization for Autism Spectrum Disorder detection. The network uses a gating mechanism to adaptively combine complementary representations and incorporates class‑distribution‑aware learning to address the imbalance between ASD and typically developing participants. Experiments on a large clinical eye‑tracking database with over 1,300 participants demonstrate that AOI‑Net outperforms state‑of‑the‑art methods and offers interpretable gaze‑behavior modeling for scalable AI‑driven ASD screening.

By Zhanpei Huang, Binbin Sun, Jialiang Chen, Yiou Wang, Taochen Chen, Yuzhu Ji, Yiqun Zhang, Yiu-Ming Cheung