arXiv Computer Vision By Kamrul Hasan, Mehedi Hasan Raju, Oleg V. Komogortsev

EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis

Read the original on arXiv Computer Vision →

EyeMakeYou is a multi‑conditional denoising diffusion model that synthesizes high‑frequency, subject‑specific gaze velocity sequences. It conditions on identity, task, and self‑reported subjective states (difficulty, mental tiredness, eye tiredness) to generate realistic 5‑second, 1000‑Hz bivariate gaze data from a reference trajectory. Experiments on the GazeBase dataset show that EyeMakeYou outperforms existing generative methods in spatial accuracy and real‑synthetic similarity while preserving task‑dependent associations with subjective reports.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
2d ago

DiTGaze: Geometry-Conditioned Diffusion Augmentation for Few-Shot Gaze Estimation

DiTGaze is a calibration‑efficient augmentation system for few‑shot gaze estimation that uses a two‑stream 3D Gaussian Splatting backbone and a geometry‑conditioned latent Diffusion Transformer. It bridges rasterized Gaussian features to latent tokens via a learnable projection and frozen VAE, and incorporates timestep, identity, and expression conditioning through Adaptive Layer Normalization. The method densifies gaze supervision with intermediate yaw‑pitch sampling and applies an orthogonality constraint to reduce interference among gaze, pose, and expression, achieving a 4.1 % reduction in generator‑level gaze error on ETH‑XGaze and outperforming baselines across all calibration budgets up to nine real images.

By Abiram Panchalingam, Indu P. Bodala, Stuart E. Middleton
arXiv Computer Vision
Oct 19

GazeCLIP: Gaze-Guided CLIP with Adaptive-Enhanced Fine-Grained Language Prompt for Deepfake Attribution and Detection

The paper introduces GazeCLIP, a gaze‑guided CLIP framework that uses adaptive‑enhanced fine‑grained language prompts for deepfake attribution and detection (DFAD). It presents a new benchmark evaluating DFAD on novel generative methods such as diffusion and flow models, and proposes a gaze‑aware image encoder (GIE) that fuses gaze prompts with image embeddings to capture global forgery patterns. A language refinement encoder (LRE) further refines language embeddings for precise vision‑language matching, achieving state‑of‑the‑art performance with 6.56% higher accuracy and 5.32% higher AUC on the benchmark.

By Yaning Zhang, Linlin Shen, Zitong Yu, Chunjie Ma, Zan Gao