arXiv Computer Vision By Abiram Panchalingam, Indu P. Bodala, Stuart E. Middleton

DiTGaze: Geometry-Conditioned Diffusion Augmentation for Few-Shot Gaze Estimation

Read the original on arXiv Computer Vision →

DiTGaze is a calibration‑efficient augmentation system for few‑shot gaze estimation that uses a two‑stream 3D Gaussian Splatting backbone and a geometry‑conditioned latent Diffusion Transformer. It bridges rasterized Gaussian features to latent tokens via a learnable projection and frozen VAE, and incorporates timestep, identity, and expression conditioning through Adaptive Layer Normalization. The method densifies gaze supervision with intermediate yaw‑pitch sampling and applies an orthogonality constraint to reduce interference among gaze, pose, and expression, achieving a 4.1 % reduction in generator‑level gaze error on ETH‑XGaze and outperforming baselines across all calibration budgets up to nine real images.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 17

GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning

GazeDiT is a diffusion model that generates synthetic eye images conditioned on a precise 4‑dimensional gaze vector by using a spatial condition derived from pupil and iris geometry. During training, a frozen SegFormer extracts this geometry from real images, while inference employs a physical eye renderer to produce gaze‑consistent geometries without needing a source image. The model achieves lower tail gaze‑label error than other diffusion baselines and improves downstream eye‑tracking accuracy, reducing error on challenging cases from 3.05° to 2.80°.

By Dongze Wu, David Colmenares, Fengting Yang, Jogendra Nath Kundu, Yao Xie, Ali Behrooz, Conny Lu
Hugging Face Trending Papers
Aug 11

Gaze Target Estimation Anywhere with Concepts

Estimating human gaze targets from images in-the-wild is an important and formidable task. Existing approaches primarily employ brittle, multi-stage pipelines that require explicit inputs, like head bounding boxes and human pose, in order to identify the subject of gaze analysis.