arXiv Computer Vision By Ra\'ul Boix-Aldeguer, Manuel Benavent-Lledo, David Ortiz-Perez, Jose Garcia-Rodriguez

Egocentric Action Recognition with Objects and Vision-Language Affordances

Read the original on arXiv Computer Vision →

The paper introduces a method for egocentric action recognition that fuses a frozen SlowFast video model with an attention-based object expert. Each object is represented by affordances generated zero‑shot from a vision‑language model, and an interaction affordance filters out non‑active detections. On the MECCANO dataset, this approach improves Top‑1 accuracy from 44.9% (video only) to 49.9% when both affordances are used, surpassing existing baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 1

EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos

arXiv:2609.39378v1 Announce Type: new Abstract: Real-world embodied tasks, from everyday activities to professional procedures, require agents to act under physical constraints while tracking evolvin...

By Shulin Tian, Junsu Kim, Shuai Liu, Hao Li, Yujiao Shen, Sihan Li, Zhe Yang, Yeongon Kim, Feiyu Li, Jialin Wu, Yichi Zhang, Wenhui Wang, Runmao Yao, Yuhao Dong, Zhaoxi Chen, Fangzhou Hong, Antonino Furnari, Jingkang Yang, Hongyuan Zhu, Ziwei Liu
arXiv Computer Vision
Nov 5

EgoM2P: Egocentric Multimodal Multitask Pretraining

EgoM2P is a masked‑modeling framework that learns from temporally‑aware multimodal tokens to train a large, general‑purpose model for egocentric 4D understanding. It supports multitasking across diverse egocentric perception and synthesis tasks—such as gaze prediction, egocentric camera tracking, monocular depth estimation, and conditional egocentric video synthesis—while matching or surpassing specialist models at a fraction of the computational cost. The authors plan to fully open‑source EgoM2P to advance egocentric vision research.

By Gen Li, Yutong Chen, Yiqian Wu, Kaifeng Zhao, Marc Pollefeys, Siyu Tang