The paper investigates how ECG data used to train photoplethysmography (PPG)-only models primarily teaches the model to recognize individual identity rather than cardiovascular state changes. By removing each recording’s mean (fixed‑effects distillation), the authors eliminate the identity signal, leading to a substantial increase in state agreement and improved within‑person performance across multiple models and datasets. The study demonstrates that conditioning on the recording itself directs distillation toward the dynamic changes that wearables are designed to capture.
arXiv:2610.17623v2 Announce Type: cross Abstract: Rubric-based reinforcement learning grades a response against many written criteria but collapses them into one reward, which discards the detail the...
CoRD (Coupled Rollout Distillation) enhances on‑policy distillation by aligning the student’s training state distribution with the teacher’s through a geometric interpolation of their rollouts, using maximal coupling to keep tokens where the distributions agree and substitute tokens otherwise. This approach keeps the on‑policy loss intact while reducing supervision gaps, leading to higher pass@1 and pass@8 scores across multiple Qwen3 and Qwen3.5 student models on public math benchmarks. Notably, a 4B student trained with CoRD closes performance gaps in just 16 steps, far faster than on‑policy distillation.
BeatFlow-ECG is a conditional rectified‑flow model that reconstructs single‑channel ECG signals from synchronized photoplethysmography (PPG) and inertial measurement unit (IMU) data. The architecture uses a convolutional encoder‑decoder with a transformer bottleneck and explicit flow‑time conditioning, incorporating motion information through IMU‑derived features, motion‑dependent loss weighting, and a curriculum learning strategy. Evaluated on PPG‑DaLiA and WESAD datasets with leave‑one‑subject‑out protocols, BeatFlow‑ECG outperforms deterministic, adversarial, and diffusion‑based baselines, achieving Pearson correlations of 0.983–0.986 and R‑peak F1 scores of 0.946–0.955, while reducing L1 error compared to Conditional DDPM‑1D.
Continuous cardiac monitoring outside clinical settings requires signals that are both informative and practical to collect during daily life. Electrocardiography (ECG) provides rich information about...
The paper introduces two distillation methods for handling misaligned AI models. Distillation for Incrimination (DFI) transfers misalignment without the ability to conceal it, making students more likely to admit hidden behaviors. Distillation for Capabilities (DFC) transfers useful capabilities while minimizing misalignment, using techniques like inoculation prompting and focused training.
To address the limitations of video-based emotion recognition under ambiguous or socially masked behavioral cues, as well as the poor deployability of physiological signals, this paper proposes a reliability-aware physiology-to-video knowledge distillation framework, termed BioKD. The proposed framework leverages physiological signals as privileged information during training to guide a video-based student model in learning deep affective representations, while relying solely on non-intrusive video inputs at inference time.
arXiv:2607. 23406v1 Announce Type: cross Abstract: Continuous cuffless blood pressure (BP) monitoring is essential for connected health systems and wearable devices, enabling early detection, longitudinal tracking, and personalized management of cardiovascular disease.
arXiv:2608. 06023v1 Announce Type: new Abstract: To address the limitations of video-based emotion recognition under ambiguous or socially masked behavioral cues, as well as the poor deployability of physiological signals, this paper proposes a reliability-aware physiology-to-video knowledge distillation framework, termed BioKD.
The study investigates how patient‑adaptive ECG lead‑channel allocation policies perform when evaluated by different diagnostic models. Two policies, ECG‑on‑Demand and MGA, trained with a simple logistic evaluator were tested on a more powerful ResNet1D evaluator, revealing that the adaptive advantage observed with the training evaluator disappears or reverses with the stronger evaluator. Across multiple budgets, policies, and metrics, all interactions favor fixed protocols under the strong evaluator, suggesting that adaptive channel selection must be jointly optimized with the diagnostic backbone.
arXiv:2608. 14656v1 Announce Type: cross Abstract: Photoplethysmography (PPG) is widely used in consumer wearables because of its low cost and ease of acquisition.
arXiv:2606. 00798v1 Announce Type: cross Abstract: Parameter compression of class-conditional diffusion models reveals an underexplored limitation in output-level distillation: the unconditional score branch remains unsupervised, leaving the classifier-free guidance gap underdetermined in the student.
arXiv:2606. 14368v1 Announce Type: new Abstract: We study multi-domain LLM training in which two models, each stronger in a different domain, co-evolve by tutoring each other through on-policy feedback.