arXiv Computer Vision

GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning

GazeDiT is a diffusion model that generates synthetic eye images conditioned on a precise 4‑dimensional gaze vector by using a spatial condition derived from pupil and iris geometry. During training, a frozen SegFormer extracts this geometry from real images, while inference employs a physical eye renderer to produce gaze‑consistent geometries without needing a source image. The model achieves lower tail gaze‑label error than other diffusion baselines and improves downstream eye‑tracking accuracy, reducing error on challenging cases from 3.05° to 2.80°.

arXiv Computer Vision
2d ago

DiTGaze: Geometry-Conditioned Diffusion Augmentation for Few-Shot Gaze Estimation

DiTGaze is a calibration‑efficient augmentation system for few‑shot gaze estimation that uses a two‑stream 3D Gaussian Splatting backbone and a geometry‑conditioned latent Diffusion Transformer. It bridges rasterized Gaussian features to latent tokens via a learnable projection and frozen VAE, and incorporates timestep, identity, and expression conditioning through Adaptive Layer Normalization. The method densifies gaze supervision with intermediate yaw‑pitch sampling and applies an orthogonality constraint to reduce interference among gaze, pose, and expression, achieving a 4.1 % reduction in generator‑level gaze error on ETH‑XGaze and outperforming baselines across all calibration budgets up to nine real images.

By Abiram Panchalingam, Indu P. Bodala, Stuart E. Middleton
arXiv Computer Vision
Oct 1

GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction

GazeFlow is a new framework for egocentric gaze prediction that models gaze as a joint distribution of temporal positions conditioned on both top‑down task cues and bottom‑up visual saliency. It employs conditional flow matching to iteratively transform Gaussian noise into realistic gaze trajectories, using a velocity field informed by video‑encoded visual features and global task queries. On standard benchmarks, GazeFlow outperforms existing methods on per‑frame metrics and produces trajectories that better reflect human gaze dynamics.

By Sheng Zhao, Weikai Lin, Yuhao Zhu
arXiv Computer Vision
Sep 7

EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis

EyeMakeYou is a multi‑conditional denoising diffusion model that synthesizes high‑frequency, subject‑specific gaze velocity sequences. It conditions on identity, task, and self‑reported subjective states (difficulty, mental tiredness, eye tiredness) to generate realistic 5‑second, 1000‑Hz bivariate gaze data from a reference trajectory. Experiments on the GazeBase dataset show that EyeMakeYou outperforms existing generative methods in spatial accuracy and real‑synthetic similarity while preserving task‑dependent associations with subjective reports.

By Kamrul Hasan, Mehedi Hasan Raju, Oleg V. Komogortsev
Hugging Face Trending Papers
Aug 11

Gaze Target Estimation Anywhere with Concepts

Estimating human gaze targets from images in-the-wild is an important and formidable task. Existing approaches primarily employ brittle, multi-stage pipelines that require explicit inputs, like head bounding boxes and human pose, in order to identify the subject of gaze analysis.

arXiv AI
Sep 4

GazeFS: Target-Centered Gaze-Trajectory Forecasting and Stabilization from Gaze-Head History

GazeFS is a model that predicts and stabilizes target‑centered gaze trajectories using a variable‑length gaze‑head history, without requiring target information during inference. It maps this history to the next target‑center direction and a short‑horizon Search/Focus estimate, improving focus target centering and reducing residual gaze error. Across 7,960 acquisition episodes from 30 participants, GazeFS reduces Focus episode bias, dispersion, and P90 target error by 0.182°, 0.257°, and 0.400°, respectively, while maintaining high phase‑balanced accuracy and AUPRC.

By Yaozheng Xia, Zaiping Zhu, Bo Pang, Minghao Xie, Hui Li, Shaorong Wang, Sheng Li
arXiv Computer Vision
2d ago

FoAViS: Analyzing Learned Fixation Strategies in a Foveated Active Vision System

FoAViS is a foveated active vision system that samples visual input using a log‑polar foveation and stores information in a 2D spatial memory. The system’s fixation policy is trained concurrently with tasks such as classification and semantic segmentation, allowing the same memory to be read out globally or densely without architectural changes. Learned fixation policies outperform non‑learned heuristics, improving task performance and producing scanpaths that resemble human gaze behavior.

By Valentin Hassler, Jonathan Henrich, Yoha\"i-Eliel Berreby, Haoze Zhu, Alexander Ecker