arXiv Computer Vision

$\unicode{x1F493}$Heartian: Physiology-Aware Relightable Gaussian Head Avatar

The paper introduces Heartian, a physiology‑aware framework that augments Gaussian head avatars with cardiac‑cycle‑dependent albedo modulation, enabling the encoding of remote photoplethysmography (rPPG) signals. By supervising with synchronized contact PPG, the method models the cardiac waveform as a sum of two Gaussians and learns per‑frame spatial residuals via a lightweight MLP. Experiments on 152 stationary recordings from UBFC‑rPPG, PURE, and MMPD show heart‑rate estimation errors as low as 0.29 bpm MAE and 0.38 % MAPE, while preserving reconstruction quality with negligible PSNR loss.

Hugging Face Trending Papers
Aug 27

Property-Specific Recoverability from Contact PPG to Camera rPPG under Heterogeneous Observation Conditions

The study examined how well specific physiological properties of contact photoplethysmography (PPG) can be recovered when converted to camera-derived remote photoplethysmography (rPPG) across 655 recordings. Using the CHROM method, the authors found that while overall heart‑rate accuracy was modest, many dynamic properties (e.g., autocorrelation, spectral measures, Lyapunov exponents) showed little recording‑specific correspondence, and differences varied with skin tone and observation conditions. The results demonstrate that preserving individual recording characteristics depends on the property and conditions, and population‑level agreement does not guarantee individual‑level fidelity.

arXiv AI
Aug 28

Property-Specific Recoverability from Contact PPG to Camera rPPG under Heterogeneous Observation Conditions

The study examined how well physiological properties from contact photoplethysmography (PPG) can be recovered by camera-based remote photoplethysmography (rPPG) across 655 recordings. Using the CHROM method, the authors found that while heart‑rate estimates showed modest accuracy, other dynamic measures such as autocorrelation, spectral content, and Lyapunov exponents largely failed to preserve recording‑specific characteristics. They also observed that lighting and motion influence endpoint accuracy, yet these factors did not explain the lack of dynamical correspondence.

By Timothy Oladunni, Farouk Ganiyu-Adewumi
arXiv Computer Vision
Sep 3

VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free video

VideoPulse is a neonatal dataset and end‑to‑end pipeline that estimates heart rate and peripheral capillary oxygen saturation (SpO2) from facial video without contact. The dataset contains 157 recordings from 52 neonates, and the pipeline uses face alignment, artifact‑aware supervision, and 3D CNN backbones to produce predictions every 2 seconds. On the NBHR dataset the model achieves a heart‑rate MAE of 2.97 bpm and SpO2 MAE of 1.69 %. "whyItMatters":"The results show that short, unaligned neonatal video segments can accurately estimate vital signs, offering a low‑cost, non‑invasive monitoring option for neonatal intensive care."

By Deependra Dewagiri, Kamesh Anuradha, Pabadhi Liyanage, Helitha Kulatunga, Pamuditha Somarathne, Udaya S. K. P. Miriya Thanthrige, Nishani Lucas, Anusha Withana, Joshua P. Kulasingham
arXiv Machine Learning
Aug 14

CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representation

arXiv:2608. 12944v1 Announce Type: new Abstract: Electrocardiography (ECG), photoplethysmography (PPG), and phonocardiography (PCG) provide complementary views of the same cardiac cycle, yet existing cardiac foundation models are trained for a single sensing modality, leaving the shared physiology across sensors unexploited.

By Hamza Shafiq, Hung Manh Pham, Bin Zhu, Pan Zhou, Jun Hu, Aaqib Saeed