arXiv AI
Diffusion models for eye-gaze trajectory generation using position and velocity representations
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
Oct 2
EyeTAG: Eye Trajectory-Aware Gaze Estimation
arXiv:2610.00922v1 Announce Type: new Abstract: Gaze estimation under natural head-eye motion underpins applications from driver monitoring to human-computer interaction. Single-frame methods predict...
arXiv Computer Vision
Aug 25
Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modeling
arXiv:2608.22926v1 Announce Type: new Abstract: Gaze is increasingly used as an input signal for vision and multimodal models, yet no consensus exists on how to represent it across datasets. Raw trac...
arXiv Computer Vision
Sep 7
EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis
EyeMakeYou is a multi‑conditional denoising diffusion model that synthesizes high‑frequency, subject‑specific gaze velocity sequences. It conditions on identity, task, and self‑reported subjective states (difficulty, mental tiredness, eye tiredness) to generate realistic 5‑second, 1000‑Hz bivariate gaze data from a reference trajectory. Experiments on the GazeBase dataset show that EyeMakeYou outperforms existing generative methods in spatial accuracy and real‑synthetic similarity while preserving task‑dependent associations with subjective reports.
arXiv Computer Vision
Oct 1
GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction
GazeFlow is a new framework for egocentric gaze prediction that models gaze as a joint distribution of temporal positions conditioned on both top‑down task cues and bottom‑up visual saliency. It employs conditional flow matching to iteratively transform Gaussian noise into realistic gaze trajectories, using a velocity field informed by video‑encoded visual features and global task queries. On standard benchmarks, GazeFlow outperforms existing methods on per‑frame metrics and produces trajectories that better reflect human gaze dynamics.
arXiv Computer Vision
Sep 17
GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning
GazeDiT is a diffusion model that generates synthetic eye images conditioned on a precise 4‑dimensional gaze vector by using a spatial condition derived from pupil and iris geometry. During training, a frozen SegFormer extracts this geometry from real images, while inference employs a physical eye renderer to produce gaze‑consistent geometries without needing a source image. The model achieves lower tail gaze‑label error than other diffusion baselines and improves downstream eye‑tracking accuracy, reducing error on challenging cases from 3.05° to 2.80°.
arXiv Machine Learning
Oct 8
TAVIS: A Benchmark for Egocentric Active Vision and Anticipatory Gaze in Imitation Learning
arXiv:2605.07943v2 Announce Type: replace-cross Abstract: Active vision -- where a policy controls its own gaze during manipulation -- has emerged as a key capability for imitation learning, with mul...