arXiv Machine Learning
Oct 12

PPG-Bench: A Unified Benchmark for PPG Foundation Models

PPG-Bench is an open‑source benchmark that evaluates five publicly available photoplethysmography (PPG) foundation models across nine datasets and 26 tasks, covering cardiovascular state estimation, activity, sleep, screening, and identification. The benchmark tests models under four downstream regimes—linear probing, random forests, frozen MLP probes, and end‑to‑end finetuning—while also comparing them to three controls: a random/constant baseline, a deterministic pulse‑rate‑variability feature set, and a generic time‑series foundation model (MOMENT). Results show that over a third of task‑regime combinations yield no advantage for any PPG foundation model over the baseline, and in most cases no PPG‑specific model outperforms the simple controls, indicating that current PPG foundation models lack generalised, transferable representations.

By Arvasu Kulkarni, Mahir Jain, Aditya Ray Mishra, Sandeep Singh, Siddharth Panwar
arXiv Computation and Language
Sep 7

WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data

WearableQA is a new benchmark that tests AI systems on health reasoning using real-world wearable data from 200 users, each with up to 500 days of daily measurements. It contains 4,084 ten‑option multiple‑choice questions derived from wearable time series, blood biomarkers, and demographics, and is organized into 16 question types that distinguish data‑driven computation from physiological interpretation and single‑signal from cross‑signal reasoning. Evaluation of 14 large language models shows wide performance gaps, indicating that the benchmark remains challenging and useful for diagnosing model capabilities.

By Ji Soo Lee, Xilun Chen, Pierce Chuang, Ashish Shenoy, Jason Wei, Dohwan Ko, Hyunwoo J. Kim, Benoit Corda
arXiv Machine Learning
Oct 23

An Agent Architecture with Tools and Memory for Selective Correction of Wrist PPG Heart Rate Estimates

The paper introduces an agent architecture that uses tools and memory to selectively correct wrist photoplethysmography (PPG) heart‑rate estimates. By generating candidate corrections from pulse, motion, and historical data, and evaluating their predicted benefits and harms, the system decides whether to retain, correct, or reject each estimate. Across four public datasets, the approach reduced mean absolute error by up to 44.5% and demonstrated real‑time deployment on a wearable‑smartphone platform.

By Xu Wang, Shuhan Yi, Zhen Cheng