Heartian: Physiology-Aware Relightable Gaussian Head Avatar
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Gaussian head avatars typically model intrinsic facial appearance as temporally static, omitting subtle cardiac-induced skin-color variation. We propose $\unicode{x1F493}$Heartian, a physiology-aware...
The paper introduces Heartian, a physiology‑aware framework that augments Gaussian head avatars with cardiac‑cycle‑dependent albedo modulation, enabling the encoding of remote photoplethysmography (rPPG) signals. By supervising with synchronized contact PPG, the method models the cardiac waveform as a sum of two Gaussians and learns per‑frame spatial residuals via a lightweight MLP. Experiments on 152 stationary recordings from UBFC‑rPPG, PURE, and MMPD show heart‑rate estimation errors as low as 0.29 bpm MAE and 0.38 % MAPE, while preserving reconstruction quality with negligible PSNR loss.
arXiv:2606. 12378v1 Announce Type: cross Abstract: Physiological awareness is important for service, social, and assistive robots that interact with humans in everyday environments.
Remote Photoplethysmography (rPPG) enables contactless pulse estimation from facial videos, serving as a vital tool for health monitoring. However, current deep learning methods often struggle under complex disturbances, particularly varying illumination, facial expressions, and unconstrained head movements.
Remote photoplethysmography (rPPG) estimates the blood volume pulse (BVP) signal from facial videos, enabling contact-free health monitoring. Conventional clip-wise approaches, which use video clips as input, require capturing over one hundred frames before inference, thus introducing several seconds of delay and hindering real-time use.
arXiv:2608. 15831v1 Announce Type: cross Abstract: Remote photoplethysmography (rPPG) enables non-contact heart rate (HR) monitoring from facial videos, but RGB-only methods are vulnerable to illumination changes, motion artifacts, and skin-tone-dependent optical reflectance.