arXiv AI

UltraArUco: A Lightweight Multilingual Library And Framework With Low-Latency Real-Time Marker-Based Tracking System For Mobile AR Interaction

arXiv:2608. 13584v1 Announce Type: cross Abstract: UltraArUco - a lightweight multilingual library and framework for low-latency, real-time marker-based tracking in mobile augmented reality.

arXiv AI
Jun 10

Integrated Real-Time Motion Tracking and AI Analysis for Athletic Performance Optimization

arXiv:2606. 09842v1 Announce Type: cross Abstract: Applying Human Pose Estimation (HPE) in real world environments remains a challenging task, this paper explores and surveys real time HPE approaches and their limitations in sports analysis for individuals, alongside developing a practical lightweight prototype for real world testing and usage.

By Parth Agrawal, Ronit, Sagar Kumar, Aashish Bhambri
arXiv AI
Jul 3

VisionAId: An Offline-First Multimodal Android Assistant for People with Visual Impairment, Featuring Personalized Object Retrieval

arXiv:2607. 02371v1 Announce Type: cross Abstract: Over 285 million people worldwide live with a visual impairment, for whom everyday tasks such as avoiding obstacles, locating personal belongings, recognizing familiar faces, or handling cash remain persistent obstacles to personal autonomy.

By Cristian-Gabriel Florea, Stelian Sp\^inu
arXiv Machine Learning
Sep 15

Speak to the City: Multimodal Resolution for Outside-the-Vehicle References

arXiv:2609.14691v1 Announce Type: cross Abstract: As autonomous vehicles and Extended Reality (XR) headsets enable novel in-car interactions, seamlessly querying physical landmarks, known as Outside-...

By Alireza Parchami (Mercedes-Benz Tech Innovation GmbH, Saarland University), Artin Saberpour (Saarland University), Robin Connor Schramm (Mercedes-Benz Tech Innovation GmbH, RheinMain University of Applied Sciences), J\"urgen Steimle (Saarland University), Ulrich Schwanecke (RheinMain University of Applied Sciences)
arXiv Computer Vision
Oct 2

Harnessing Vision-Language Models for Perceptual Quality Assessment and Autonomous Content Adjustment in Augmented Reality

The paper introduces RateAR, a benchmark of AR images and videos that captures perceptual factors such as object placement, scale, and shadow consistency. Eleven commercial vision‑language models (VLMs) are evaluated on this benchmark, with VLM‑based quality predictions showing strong correlation with human judgments (Spearman’s ρ up to 0.8695). Using contextual prompting, the authors build an automated AR content adjustment system that, in a 21‑participant study, improved placement and size coherence of virtual content for over 90% of users.

By Elias Rotondo (Duke University), Lin Duan (Duke University), Yanming Xiu (Duke University), Sangjun Eom (Duke University), Conrad Li (Duke University), Maria Gorlatova (Duke University)
arXiv AI
Aug 13

Empowering Children to Create AI-Enabled Augmented Reality Experiences

arXiv:2508. 08467v2 Announce Type: replace-cross Abstract: Despite their potential to enhance children's learning experiences, AI-enabled AR technologies are predominantly used in ways that position children as consumers rather than creators.

By Lei Zhang, Shuyao Zhou, Amna Liaqat, Tinney Mak, Brian Berengard, Emily Qian, Andr\'es Monroy-Hern\'andez
arXiv Machine Learning
Aug 18

Helios 2.0: A Robust, Ultra-Low Power Gesture Recognition System Optimised for Event-Sensor based Wearables

arXiv:2503. 07825v3 Announce Type: replace-cross Abstract: We present an advance in wearable technology: a mobile-optimized, real-time, ultra-low-power event camera system that enables natural hand gesture control for smart glasses, dramatically improving user experience.

By Prarthana Bhattacharyya, Joshua Mitton, Ryan Page, Owen Morgan, Oliver Powell, Benjamin Menzies, Gabriel Homewood, Kemi Jacobs, Paolo Baesso, Taru Muhonen, Richard Vigars, Louis Berridge
arXiv Machine Learning
Jul 3

Sign in the Air to Unlock: An Interface for authentication in Virtual and Augmented Reality Powered by Point-Voxel Cross-Attention Network

arXiv:2607. 01435v1 Announce Type: cross Abstract: Significant advancement of immersive technologies such as Virtual and Augmented Reality (VR/AR) and their integration into diverse aspects of modern life need authentication interfaces that are secure, intuitive, and compatible with embodied interaction.

By Neda Abdolrahimi, Thiru Siddharth, Frank Sicongchen, Vir V Phoha
arXiv Computer Vision
Sep 21

OpenSAL360: Open-Source Crowdsourcing Platform for Omnidirectional Video Saliency Collection

OpenSAL360 is an open‑source platform that enables scalable, low‑cost collection of 360° video saliency data using only a standard screen, mouse, and internet connection. It bypasses the need for VR headsets, allowing parallel data collection from crowdsourced assessors. The authors validated the protocol against seven VR eye‑tracking datasets, performed ablation studies, and released a new dataset of 500 omnidirectional videos annotated by over 2,000 assessors, the largest in the field to date.

By Alexey Bryncev, Andrey Moskalenko, Kira Shilovskaya, Ivan Kosmynin, Dmitriy Vatolin