arXiv Machine Learning

TrustmeWatcher: An Application for Workplace Micro-Sensing and Explainable Well-Being Feedback

TrustmeWatcher is an application developed for the TRUST‑ME project that integrates OS‑level activity monitoring from ActivityWatch with a user interface for well‑being feedback. It transforms computer‑activity traces into an interactive screen‑time dashboard, synchronizes short questionnaire responses from a StreamDeck, and displays these alongside video highlights. The app uses local AI models to predict six normalized state scores and an overall well‑being score, providing explainable AI insights and privacy controls such as camera and eye‑tracker pause/resume, and has been tested with records from 17 participants.

arXiv Computer Vision
Oct 22

ProactEgoMem: Benchmarking Proactive Memory in Streaming Egocentric Video

ProactEgoMem is a benchmark for evaluating proactive memory in streaming egocentric video, focusing on three tasks—Information Capture, State Tracking, and Location Tracking—to reflect real-world environmental needs. It introduces two levels of proactiveness: Notification Level, which requires a single timely alert, and Intervention Level, which demands continuous memory maintenance via an active tool lifecycle. The benchmark includes daily and scientific datasets with corresponding QA sets, and shows that current models struggle to capture memory both timely and accurately.

By Ruotong Liao, Meikel Kokowski, Xiaoxiao Sun, Yongqin Xian, Laura Bravo S\'anchez, Shiye Su, Federico Tombari, Serena Yeung-Levy, Volker Tresp