arXiv AI

Investigating Anthropometric Fidelity in SAM 3D Body

The paper examines the SAM 3D Body model’s difficulty in accurately capturing detailed anthropometric variations—such as those seen in geriatric muscle atrophy, scoliosis, or pregnancy—despite clear visual cues. It attributes this limitation to a perception‑distortion trade‑off arising from the model’s reliance on a low‑dimensional parametric MHR representation, semantic‑invariant conditioning, and annotation‑based alignment, which collectively cause a regression‑to‑the‑mean effect. The authors propose future directions, including hybrid representations and medical‑in‑the‑loop alignment, to enhance the model’s precision for medical applications.

arXiv Computer Vision
Oct 28

UT-HMR: Uncertainty-Guided Temporal Modeling for Robust 3D Human Mesh Recovery

UT‑HMR is a one‑stage monocular 3D human mesh recovery framework that introduces uncertainty‑guided temporal modeling to address ambiguities caused by weak observations such as distance, occlusion, and motion blur. It predicts a Gaussian distribution over SMPL pose with a low‑rank-plus‑diagonal covariance, converting this into joint‑wise precision weights for heteroscedastic supervision while keeping inference deterministic. Temporal early fusion incorporates neighboring‑frame evidence before pose decoding, enabling the model to resolve pose ambiguities and achieve state‑of‑the‑art results on VIP‑HockeyPose‑v2, WorldPose, and competitive performance on 3DPW using a lightweight ViT‑B backbone.

By Zhibo Wang, Sirisha Rambhatla, Yuhao Chen, Maria Koshkina, David Clausi
arXiv Computer Vision
Sep 14

GNM Head: A Generative aNthropometric Model of the human head

The paper introduces GNM Head, a generative anthropometric model that extends beyond traditional head models by including detailed ocular and intra‑oral structures such as eyeballs, teeth, and tongue. Built from a large collection of high‑resolution 3D scans and artist‑crafted samples, GNM offers improved geometric fidelity and state‑of‑the‑art fitting performance for target 3D face scans. The authors release the full framework publicly to support further research and development.

By Stylianos Ploumpis, Jan Bednarik, Gaspard Zoss, Ruslan Guseinov, Luca Prasso, Prashanth Chandran, Oliver Boyne, Vasileios Choutas, Timo Bolkart, Daoye Wang, Menglei Chai, Di Qiu, Sebastian Winberg, Gilles Rainer, Lewis Bridgeman, Leonhard Helminger, Edo Collins, Delio Vicini, J\'er\'emy Riviere, Yannick Boetzel, Alexander Koumis, Stylianos Moschoglou, Jay Busch, Cynthia Herrera, Jacob Still, Scott Ysebert, Peter Lincoln, Sergio Orts Escolano, Christoph Rhemann, Erroll Wood, Thabo Beeler, Stefanos Zafeiriou