The paper introduces Doppio, a new video dataset of falling ground coffee with per‑frame weight measurements, aimed at enabling contactless mass estimation via computer vision. The authors evaluate several deep learning models—spatial feed‑forward networks and recurrent spatio‑temporal architectures—to predict the cumulative weight of the falling particles. Results show that these models can accurately estimate weight, suggesting a viable, low‑cost alternative to traditional contact‑based measurement systems.
By Simon Kiefhaber, Jan-Martin O. Steitz, Julia Grabinski, Christoph Reich, Paul Wagner, Max Zimmermann, Simone Schaub-Meyer, Stefan Roth
PACT is an end‑to‑end model that jointly learns human pose, contacts, and contact forces from monocular video. It augments a human reconstruction foundation model with learnable contact‑force tokens and a temporal transformer, and uses physics‑based supervision to enforce consistency between motion and forces. The authors also create a data annotation pipeline and a real‑world climbing benchmark, ForceWall, to train and evaluate the system, achieving state‑of‑the‑art performance and better generalization than staged approaches.
By Rikhat Akizhanov (MBZUAI), Yangsong Zhang (MBZUAI), Nikolai Kaliazin (MBZUAI), Peter Wolf (ETH Z\"urich), Yoshihiko Nakamura (MBZUAI), Pascal Fua (EPFL), Fabio Pizzati (MBZUAI), Ivan Laptev (MBZUAI)
Event cameras, also known as neuromorphic cameras, have gained significant attention in recent years due to their high temporal resolution, high dynamic range, and low power consumption. While many studies and datasets in neuromorphic vision have focused on automotive and drone applications, human-centric daily-life scenarios remain largely underrepresented, despite their importance for developing and benchmarking event-based perception systems.
arXiv:2610.13242v1 Announce Type: new
Abstract: Currently, the animal production sector is undergoing rapid development of techniques that allow automatic monitoring of animal behaviour and health. T...
By Sebastian Puchala, Dominik Gronkiewicz, Marcin Go{\l}\k{e}biewski, Grzegorz Grodkowski, Grzegorz Gwardys
arXiv:2607. 12909v1 Announce Type: cross Abstract: Falling detection is vital for elderly care and intelligent surveillance; however, prevailing vision-based approaches predominantly frame it as static pose classification or discrete temporal pattern matching, fundamentally overlooking the instability dynamics of the human support system.
By Wenjun Xia, Zhicheng Peng, Haopeng Li, Zhengdi Zhang
arXiv:2510. 26369v2 Announce Type: replace Abstract: Logistics warehouses have struggled with labor shortages, but the inbound processes remain particularly human-powered.
By Kazuma Kano, Yuki Mori, Shin Katayama, Kenta Urano, Takuro Yonezawa, Nobuo Kawaguchi
arXiv:2608.13014v2 Announce Type: replace
Abstract: Understanding hand-object interaction from egocentric vision is essential for modeling how people physically engage with the surrounding world. Yet...
By Andela Ilic, Rachel Schuchert, Yijing Jiang, Christian Holz
arXiv:2604. 22160v2 Announce Type: replace-cross Abstract: Human visual perception offers valuable insights for understanding computational principles of motion-based scene interpretation.
By Eric Li, Arijit Dasgupta, Yoni Friedman, Mathieu Huot, Vikash Mansinghka, Thomas O'Connell, William T. Freeman, Joshua B. Tenenbaum
SnapPhysics is a training‑free framework that reconstructs 3D objects and estimates their physical properties—such as mass, friction, and center of gravity—from a single image. It combines instance‑level 3D reconstruction with a physics‑aware scene graph that encodes inter‑object relationships, providing structured context for vision‑language model reasoning. Experiments on 3D‑FRONT and real captured scenes show significant improvements over prior methods, reducing errors in mass estimation and enhancing scene‑level F‑Score.
arXiv:2508. 12435v2 Announce Type: replace-cross Abstract: While gesture recognition using vision or robot skins is an active research area in Human-Robot Collaboration (HRC), this paper explores deep learning methods relying solely on a robot's built-in joint sensors, eliminating the need for external sensors.
By Deqing Song, Weimin Yang, Maryam Rezayati, Hans Wernher van de Venn
arXiv:2606. 18732v1 Announce Type: new Abstract: This work presents the development of hybrid models that integrate spiking neural networks (SNNs) with components of convolutional neural networks (CNNs) to learn from simulated event-based camera data (Dynamic Vision Sensor, DVS) generated from conventional smartphone videos.
By Guillermo Rojas, Gonzalo Soto, Daniel Yunge
arXiv:2602. 08058v3 Announce Type: replace-cross Abstract: In the presence of occlusions and measurement noise, geometrically accurate scene reconstructions -- which fit the sensor data -- can still be physically incorrect.
By Xihang Yu, Rajat Talak, Lorenzo Shaikewitz, Luca Carlone