arXiv Computer Vision

FitControler: Toward Fit-Aware Virtual Try-On

FitControler introduces a fit-aware virtual try‑on system that adds garment fit control to existing VTON models. It uses a fit‑aware layout generator and a multi‑scale fit injector to redraw body‑garment layouts and render garments that match those layouts. The authors also release a new Fit4Men dataset of 13,000 body‑garment pairs and two fit consistency metrics to evaluate fit quality.

arXiv Computer Vision
Sep 7

HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork Conditioning

The paper introduces HyperBones, a real‑time garment simulation framework that combines a reduced‑space neural dynamics simulator with a lightweight neural network correcting Linear Blend Skinning (LBS) at a coarse level, and a convolutional MLP for fine‑scale wrinkle recovery in UV space. By decoupling identity‑specific computation from shape conditioning through a hypernetwork, the method achieves high performance without an offline simulator, delivering physically plausible dynamics across diverse motions and unseen body shapes. Experiments demonstrate a speedup of over 30× compared to state‑of‑the‑art autoregressive neural simulators, reaching interactive inference at roughly 1 ms per frame on a consumer GPU.

By Astitva Srivastava, Hsiao-Yu Chen, Ryan Goldade, Philipp Herholz, Zhongshi Jiang, Gene Wei-Chin Lin, Lingchen Yang, Nikolaos Sarafianos, Tuur Stuyck, Avinash Sharma, Egor Larionov
arXiv AI
Sep 1

GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns

GarmentWeaver is a new framework for multimodal sewing pattern generation that uses a schema‑aware approach to construct compact hierarchical targets. By activating garment‑relevant structural branches and building on a pretrained vision‑language model, it predicts executable sewing patterns in a structured manner. Experiments show that GarmentWeaver produces more accurate, executable patterns and yields better simulation results than strong baselines.

By Yinwen Lu, Weihao Luo, Yueqi Zhong
arXiv Computer Vision
Sep 3

MMTryon: Multi-Modal Multi-Reference Control for High-Quality Fashion Generation

MMTryon is a multi‑modal, multi‑reference virtual try‑on framework that generates high‑quality compositional try‑on results using text instructions and multiple garment images. It addresses three overlooked problems: supporting multiple try‑on items, allowing dressing style specification via text, and eliminating reliance on segmentation models by using a parsing‑free garment encoder and a scalable data generation pipeline. Experiments on high‑resolution benchmarks and in‑the‑wild test sets show MMTryon outperforms state‑of‑the‑art methods qualitatively and quantitatively.

By Xujie Zhang, Ente Lin, Michael Kampffmeyer, Zhenyu Xie, Jiang Li, Ting Liu, Xiaochao Qu, Luoqi Liu, Xiaodan Liang
arXiv Computer Vision
3d ago

Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need

The paper introduces AvaImg, a multi‑stage optimization pipeline that achieves high‑fidelity SMPL(-X)+D registrations with UV texture for arbitrary clothed scans. By enforcing a body‑inside‑clothing constraint through signed winding numbers and employing a three‑level efficiency cascade, AvaImg significantly reduces runtime and storage while recovering fine surface detail via coarse‑to‑fine displacement optimization. The resulting textured registrations are nearly indistinguishable from scans, and encoding the UV maps with a frozen FLUX VAE demonstrates compatibility with 2D generative models, enabling 3D avatar generation using image‑based priors.

By Margaret Kostyrko, Yuxuan Xue, Garvita Tiwari, Gerard Pons-Moll