This paper introduces an Edge AI system that classifies sleep and wake states on constrained devices using a multimodal pipeline on an ESP32‑S3 microcontroller. It fuses inertial head‑movement sensing with visual pose classification, running in parallel under FreeRTOS to meet real‑time constraints. The two‑stage detection achieves 96.5 % accuracy for motion‑based detection and 89 % for pose classification, proving robust binary sleep‑wake classification in mobile scenarios.
By Stefan Reitmann, Lena Oden
arXiv:2607. 03213v1 Announce Type: cross Abstract: We present OpenGlass, an open-source, privacy-oriented, local-first system for low-latency multimodal visual assistance, with a primary focus on blind and low-vision users.
By Mengzhang Li, Yuan Yao
arXiv:2608. 19639v1 Announce Type: new Abstract: Streaming reconstruction of Free-Viewpoint Videos (FVVs) supports immersive Internet of Things (IoT) services, such as telepresence and digital twin visualization.
By Yiwei Li, Jiannong Cao, Weixun Gao, Rui Cao, Songye Zhu, Yinfeng Cao, Mingjin Zhang
EgoKit is a toolkit that standardizes egocentric video recording across six different host devices, providing a uniform recording workflow and log format. It supports synchronized ego-view and wrist-view capture, and on XR headsets it logs head pose and hand tracking aligned to the video. The toolkit includes accessories such as wrist cameras, a head strap, and a USB-C hub, enabling wrist-view capture without custom hardware, and has been validated to train robot policies comparable to those trained on other datasets.
By Liuchuan Yu, Erdem Murat, Beichen Wang, Yan Zeng, Tingting Luo, Huizhen Zhou, Shanghao Li, Huining Feng, Zhigen Zhao, Ning Yang, Ke Jing, Yunhao Liu, Ruoya Sheng
arXiv:2609.24482v1 Announce Type: new
Abstract: Monocular 3D human pose estimation (HPE) remains challenging due to depth ambiguity, occlu- sions, and the need for temporal consistency. While multi-v...
By Mena Kamel, Natalie Won, Amrut Sarangi, Sven Jager, Albert Pla Planas
Streaming reconstruction of Free-Viewpoint Videos (FVVs) supports immersive Internet of Things (IoT) services, such as telepresence and digital twin visualization. Existing methods suffer from high per-frame optimization time and large storage footprints, limiting deployment on resource-constrained Edge-IoT devices.
Kineo is a fully automatic, calibration‑free pipeline that performs markerless motion capture using unsynchronized, uncalibrated consumer‑grade RGB cameras. It uses 2D keypoints from existing detectors to jointly calibrate cameras (including distortion), reconstruct 3D keypoints, and generate dense scene pointmaps at metric scale. The method introduces confidence‑aware subsampling, graph‑based optimization, and a pairwise reprojection consistency score to achieve robust calibration and accurate metric scale recovery, achieving significant error reductions on EgoHumans and Human3.6M datasets while remaining computationally efficient.
By Charles Javerliat, Pierre Raimbaud, Guillaume Lavou\'e
WARP-VLA is a Vision‑Language‑Action model designed to be robust to variations in wrist‑camera viewpoints. It uses a Mixture‑of‑Experts architecture where each expert learns a view‑specific feature transformation, and a router selects the appropriate expert based on implicit view cues, eliminating the need for explicit camera extrinsic parameters. Experiments on the LIBERO benchmark show that WARP‑VLA doubles the success rate of pi‑0.5 from 39.2% to 78.3% under wrist‑view perturbations, and real‑robot tests confirm that the simulation‑learned adaptation transfers to diverse deployment settings.
By Junmyeong Lee, Dongmin Shin, Min-Gyu Park, Wooseok Jeon, Inho Chang, Hae-Gon Jeon
SituHOI is a large‑scale RGB‑D dataset that captures full‑body human‑object interactions in 16 indoor rooms, comprising 18,429 annotated clips and about 86 hours of activity. The dataset pairs moving‑camera recordings with static scene scans, object geometry, language descriptions, and estimated human and object trajectories, all registered in a shared floor‑aligned frame via a pipeline that integrates camera localization, depth‑based alignment, human mesh recovery, and object tracking. The data enable the FlexHOI‑Bench benchmark for goal‑conditioned joint motion prediction, and a reference predictor, SharedHOI, demonstrates strong performance on world‑space accuracy and human‑object coordination.
whyItMatters":"The dataset provides scalable, scene‑aligned supervision for modeling human‑object interaction, addressing a key limitation of existing datasets and enabling more accurate motion prediction benchmarks."
By Qifan Wang, Qihang Fang, Boao Shi, Yushi Du, Pei Zhou, Siyan Dong, Yanchao Yang
The paper introduces G2G, a method that leverages known intra-group geometry to estimate the relative 6-DoF pose between two image groups, a key problem in cross-sequence relocalization and multi-camera rig odometry. G2G keeps a frozen foundation model and adds three lightweight trainable modules—a perceiver resampler, a cross-group bridge with merged self-attention, and a multi-frame pose head—totaling about 32 M parameters, less than 6% of the full model. Evaluated on four diverse datasets covering indoor/outdoor simulation, real-world cross-season capture, and zero-shot sim-to-real transfer, G2G achieves state‑of‑the‑art accuracy on both pose estimation tasks while only requiring supervision from relative poses.
By Yufei Wei, Shuhao Ye, Chenxiao Hu, Yiyuan Pan, Dongyu Feng, Rong Xiong, Yue Wang, Yanmei Jiao
arXiv:2610.19857v1 Announce Type: new
Abstract: Recovering 3D human motion from sparse wearable sensors is challenging due to the inherent noise, occlusion, and instability of real-world tracking sig...
By Minghao Liu, Tutian Tang
arXiv:2609.15032v1 Announce Type: new
Abstract: Live free-viewpoint visualization of real humans is critical for immersive communication and interactive digital experiences. Existing methods either r...
By Hanzhang Tu, Zhanfeng Liao, Wei Min, Jiajun Zhang, Yebin Liu