arXiv Machine Learning
Sep 25

Edge AI on Constrained Devices for Binary Sleep-Wake Classification in Dynamic Environments

This paper introduces an Edge AI system that classifies sleep and wake states on constrained devices using a multimodal pipeline on an ESP32‑S3 microcontroller. It fuses inertial head‑movement sensing with visual pose classification, running in parallel under FreeRTOS to meet real‑time constraints. The two‑stage detection achieves 96.5 % accuracy for motion‑based detection and 89 % for pose classification, proving robust binary sleep‑wake classification in mobile scenarios.

By Stefan Reitmann, Lena Oden
arXiv Computer Vision
1d ago

EgoKit: Towards Unified Low-Cost Egocentric Data Collection with Heterogeneous Devices

EgoKit is a toolkit that standardizes egocentric video recording across six different host devices, providing a uniform recording workflow and log format. It supports synchronized ego-view and wrist-view capture, and on XR headsets it logs head pose and hand tracking aligned to the video. The toolkit includes accessories such as wrist cameras, a head strap, and a USB-C hub, enabling wrist-view capture without custom hardware, and has been validated to train robot policies comparable to those trained on other datasets.

By Liuchuan Yu, Erdem Murat, Beichen Wang, Yan Zeng, Tingting Luo, Huizhen Zhou, Shanghao Li, Huining Feng, Zhigen Zhao, Ning Yang, Ke Jing, Yunhao Liu, Ruoya Sheng