The paper introduces a redundancy-aware fusion framework for EgoExo proficiency estimation, which integrates fine-grained motion cues from egocentric views with spatial context from exocentric views. It identifies multiview redundancy and overfitting as key challenges and proposes two modules—AdaMVS for adaptive view selection and VIB-GB for compressing redundant signals—to address them. Experiments on EgoExo-4D and EgoExo-Fitness show that the method learns to select informative views and fuse them effectively, achieving state‑of‑the‑art results.
By Xu Dong, Wanqing Li, Anthony Adeyemi-Ejeye, Andrew Gilbert
Multimodal fusion learning (MFL) has shown great potential in the medical domain, where we are faced with disparate data modalities such as imaging, clinical records, and omics. However, existing MFL strategies face several major challenges.
arXiv:2607. 00808v1 Announce Type: new Abstract: Pre-training on large-scale videos to improve reinforcement learning efficiency is promising yet remains challenging.
By Jinwen Wang, Youfang Lin, Xiaobo Hu, Shuo Wang, Kai Lv
The paper "End-to-End Visual Odometry with RNNs and Attention" presents a study of deep‑learning approaches to visual odometry (VO), proposing a novel temporal attention‑based model to enhance performance. It evaluates existing end‑to‑end VO methods and explores their effectiveness on hand‑held camera data, contrasting with the typical driving‑scene training sets. The work aims to improve VO accuracy in more dynamic and complex visual environments.
By Ruiyu Li, Yinjia Liu, Alexander Yu
arXiv:2605. 00271v3 Announce Type: replace-cross Abstract: Event cameras provide several unique advantages over standard frame-based sensors, including high temporal resolution, low latency, and robustness to extreme lighting.
By Vincenzo Polizzi, David B. Lindell, Jonathan Kelly
arXiv:2606. 13970v1 Announce Type: cross Abstract: Learning with missing modalities is a fundamental challenge in multimodal robot learning, as real-world robotic systems often operate in environments with incomplete sensor data.
By Zhitian Zhang, Wenjie Zi, Yunduz Rakhmangulova, Saghar Irandoust, Hossein Hajimirsadeghi, Thibaut Durand
arXiv:2409. 16663v5 Announce Type: replace-cross Abstract: We propose the use of latent space generative world models to address the covariate shift problem in autonomous driving.
By Alexander Popov, Alperen Degirmenci, David Wehr, Shashank Hegde, Ryan Oldja, Alexey Kamenev, Bertrand Douillard, David Nist\'er, Urs Muller, Ruchi Bhargava, Stan Birchfield, Nikolai Smolyanskiy
arXiv:2608.30388v1 Announce Type: cross
Abstract: Cross-view video representation learning aims to capture viewpoint-invariant action semantics despite substantial appearance changes across egocentri...
By Youngchae Chee, Hosu Lee, Sungjune Park, Junho Kim, Yong Man Ro
arXiv:2605.06192v2 Announce Type: replace-cross
Abstract: Pretrained video diffusion models provide powerful spatiotemporal generative priors, making them a natural foundation for robotic world model...
By Zhaoyang Yang, Yurun Jin, Lizhe Qi, Cong Huang, Kai Chen
arXiv:2603.25175v2 Announce Type: replace
Abstract: Monocular egocentric 3D pose estimation is difficult because severe foreshortening, self-occlusion, and a restricted field of view often remove the...
By Md Mushfiqur Azam, John Quarles, Kevin Desai
arXiv:2607. 22702v1 Announce Type: cross Abstract: Text-motion representation learning has advanced rapidly, with growing interest in multi person interactions for animation, AR/VR, and embodied AI.
By Addison Zucek, Prerit Gupta, Kamila Kuatova, Aniket Bera
arXiv:2610.18447v2 Announce Type: new
Abstract: World models have emerged as a promising paradigm for embodied AI, yet existing systems often remain fragmented in the modalities they model and the fu...
By Thinker Team, Peng Gao, Jichao Jiao, Chen Liao, Daqin Luo, Yiming Ma, Baiyu Pan, Hailin Shi, Jiyuan Wang, Xiangming Xu, Xiongwei Zhao