Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Creating photorealistic and temporally coherent animatable human avatars from RGB videos remains challenging. Current methods struggle to capture realistic cloth dynamics, producing over-smoothed appearance or severe artifacts on out-of-distribution poses.
arXiv:2511. 18765v3 Announce Type: replace-cross Abstract: Existing industrial 3D garment meshes already cover most real-world clothing geometries, yet their texture diversity remains limited.
BooM‑VVT is a mask‑free video virtual try‑on framework that builds on a keyframe‑driven paradigm. It introduces a multi‑stage training strategy using image‑level pseudo data to learn mask‑free localization, a garment‑sensitive keyframe sampling method to capture garment appearance, and a Frame‑Shared 3D‑RoPE module to align keyframes with target video frames for accurate garment detail transfer. The authors also release OmniView, a large‑scale multi‑view try‑on dataset, and demonstrate that BooM‑VVT outperforms existing methods in temporal consistency and garment fidelity.
BooM-VVT is a mask‑free video virtual try‑on framework that builds on a keyframe‑driven paradigm. It uses a multi‑stage training strategy with image‑level pseudo data to learn mask‑free localization, introduces Garment‑Sensitive Keyframe Sampling to capture garment appearance, and employs Frame‑Shared 3D‑RoPE for spatiotemporal correspondence. The authors also create the OmniView dataset to support diverse camera viewpoints and tasks, achieving superior temporal consistency and garment fidelity compared to existing methods.
The paper introduces HyperBones, a real‑time garment simulation framework that combines a reduced‑space neural dynamics simulator with a lightweight neural network correcting Linear Blend Skinning (LBS) at a coarse level, and a convolutional MLP for fine‑scale wrinkle recovery in UV space. By decoupling identity‑specific computation from shape conditioning through a hypernetwork, the method achieves high performance without an offline simulator, delivering physically plausible dynamics across diverse motions and unseen body shapes. Experiments demonstrate a speedup of over 30× compared to state‑of‑the‑art autoregressive neural simulators, reaching interactive inference at roughly 1 ms per frame on a consumer GPU.
arXiv:2608. 19900v1 Announce Type: new Abstract: For full-body avatars, modeling surface dynamics is crucial for overcoming the uncanny valley and achieving perceptual realism.