Hugging Face Trending Papers

Metric Scale for Insta360 Structure-from-Motion from the Camera's Embedded IMU

arXiv Computer Vision
Aug 28

Camera Calibration Using Inaccurate and Asynchronous Discrete GPS Trajectory from Drones

The paper tackles the problem of calibrating a stationary camera’s yaw, pitch, and roll using a drone’s GPS trajectory, which suffers from altitude bias, time offset, and discrete sampling. It formulates a parameter estimation problem that jointly estimates the GPS altitude bias, time offset, and camera orientation biases, and proposes a maximum likelihood estimator based on Iterated Least Squares to handle the asynchronous, discrete GPS data. Simulation results show the estimator achieves accuracy close to the Cramér–Rao Lower Bound, with a recommended drone trajectory yielding calibration errors within 14% of the measurement error standard deviation.

By R. Yang, Y. Bar-Shalom, H. A. J. Huang
arXiv Computer Vision
Sep 3

MuyBridge: Mobile Human Center-of-Mass Estimation from Monocular Video via Sparse Fusion

MuyBridge is an on-device system that estimates an athlete’s segmental center of mass (CoM) trajectory from a single phone camera video stream. It combines a compact 2D pose network with a distilled monocular depth network, fusing their outputs through anatomical and physical priors to produce metric CoM estimates without requiring 3D or task‑specific supervision. On the AthletePose3D dataset, MuyBridge achieves 33–41 mm vertical CoM error and 2.3–6.6 % absolute‑relative range error, delivering CoM estimates at 63 FPS on an iPhone 15 with asynchronous depth updates.

By Aidan Bradshaw, Marco Giordano, David Rode, Andreas Habersack, Elif Basokur, Annika Kruse, Markus Tilp, Michele Magno, Peter Wolf, Luca Benini, Christoph Leitner
arXiv Computer Vision
Oct 12

What Egocentric Video Embeddings Encode and How to Combine Them with Inertial Sensors for Human Activity Recognition

The paper investigates what information is captured by egocentric video embeddings from models such as VideoMAEv2, CLIP, DINOv2, and VC-1, finding that the leading principal components largely reflect where the head‑mounted camera is looking. It also explores how to combine these video embeddings with body‑worn inertial sensor data for human activity recognition, showing that propagating inertial predictions over a video‑based graph can significantly improve classification performance (macro‑F1 from 0.648 to 0.852). The study demonstrates that video and inertial modalities play distinct roles—video identifies similar clips within a set, while inertial data labels the activities—yet fusing them directly in a single classifier or adding inertial edges to the graph does not yield better results.

By Kansuke Habano
arXiv Machine Learning
Sep 23

GINIO: A Geometric SO(3)-Equivariant Interface for Neural Inertial Odometry

GINIO is a geometric SO(3)-equivariant interface designed for neural inertial odometry that ensures learned measurements transform consistently under any IMU mounting convention. It predicts motion measurements and uncertainties that obey vector and tensor transformation laws, and introduces Last-Frame Alignment to enable efficient sensor-frame learning equivalent to world-frame training. The interface is instantiated in several architectures—filter-connected NIO, AirIO-style recurrent aerial prediction, EqNIO-style full-SO(3) canonicalization, and ResNet-style temporal backbones—achieving significant accuracy and efficiency gains across multiple benchmarks.

By Chankyo Kim, Minghan Zhu, Tzu-Yuan Lin, Avantika Rattan, Maani Ghaffari
Hugging Face Trending Papers
Aug 5

Differential 6-DOF Pose Estimation with Provable First-Order Immunity to Camera Calibration Errors

Accurate six-degree-of-freedom (6-DOF) motion estimation is essential for robotic manipulation, autonomous systems, and structural displacement monitoring. Conventional 3D-2D methods estimate absolute camera poses independently at each time and recover platform motion through camera-to-platform extrinsics, making them sensitive to extrinsic calibration errors, especially for micromotion.

arXiv Computer Vision
Sep 24

DAVIO: Dense Monocular-Inertial SLAM with Feed-Forward Initialization and Pose-Conditioned Mapping

DAVIO is a dense monocular‑inertial SLAM system that leverages a single multi‑view depth model (Depth Anything 3) for both initialization and mapping. It starts up quickly by solving a feature‑free linear system from a five‑image window and IMU pre‑integration, then uses a VIO filter whose metric poses condition the depth model during tracking. The system corrects residual scale along viewing rays, preserves metric baselines, and refines the map with a gravity‑preserving sub‑map graph, achieving earlier start‑up, lower localization error, and more accurate dense maps than state‑of‑the‑art feed‑forward mappers on both EuRoC and building‑scale ORI datasets.

By Jaafar Mahmoud, Arthur Movsesyan, Mikhail Iumanov, Sergey Kolyubin
arXiv Computer Vision
Sep 11

DefVINS: Visual-Inertial Odometry for Deformable Scenes

DefVINS is a visual‑inertial odometry pipeline tailored for deformable scenes, breaking the rigidity assumption of traditional VIO. It decomposes the odometry state into a rigid, IMU‑anchored component and a non‑rigid scene warp using an embedded deformation graph. The authors also introduce VIMandala, the first real‑world benchmark with ground‑truth camera poses for deformable VIO, and extend the synthetic Drunkard’s benchmark with inertial data, demonstrating that DefVINS outperforms both rigid and non‑rigid baselines.

By Samuel Cerezo, Javier Civera