← Back to all news
arXiv Computer Vision

TAMF-VTON: Token-Wise Sparse Adaptation for Mask-Free Virtual Try-On

TAMF-VTON is a diffusion-based virtual try‑on system that eliminates the need for segmentation masks, parsing maps, pose representations, or spatial controls during inference. It uses token‑wise sparse Mixture‑of‑Experts adaptation to provide input‑dependent capacity, along with timestep‑weighted frequency supervision and adaptive offline data construction to improve high‑frequency reconstruction and cross‑category training. The method achieves top performance on single‑garment VITON‑HD and DressCode benchmarks, supports multi‑garment transfer, and can generate 1K‑resolution images in under 15 seconds on an RTX 4090.

Related stories

arXiv Computer Vision
Sep 4

BooM-VVT: Boosting Mask-Free Video Virtual Try-On with Image-Level Pseudo Data

BooM‑VVT is a mask‑free video virtual try‑on framework that builds on a keyframe‑driven paradigm. It introduces a multi‑stage training strategy using image‑level pseudo data to learn mask‑free localization, a garment‑sensitive keyframe sampling method to capture garment appearance, and a Frame‑Shared 3D‑RoPE module to align keyframes with target video frames for accurate garment detail transfer. The authors also release OmniView, a large‑scale multi‑view try‑on dataset, and demonstrate that BooM‑VVT outperforms existing methods in temporal consistency and garment fidelity.

By Wei Zhang, Xin Li, Peishu Shi, Jialin Gao, Xuekang Peng, Zhichao Lian, Yeying Jin
diffusion
More like this →
Hugging Face Trending Papers
Sep 3

BooM-VVT: Boosting Mask-Free Video Virtual Try-On with Image-Level Pseudo Data

BooM-VVT is a mask‑free video virtual try‑on framework that builds on a keyframe‑driven paradigm. It uses a multi‑stage training strategy with image‑level pseudo data to learn mask‑free localization, introduces Garment‑Sensitive Keyframe Sampling to capture garment appearance, and employs Frame‑Shared 3D‑RoPE for spatiotemporal correspondence. The authors also create the OmniView dataset to support diverse camera viewpoints and tasks, achieving superior temporal consistency and garment fidelity compared to existing methods.

diffusion
More like this →
arXiv Computer Vision
Sep 3

MMTryon: Multi-Modal Multi-Reference Control for High-Quality Fashion Generation

MMTryon is a multi‑modal, multi‑reference virtual try‑on framework that generates high‑quality compositional try‑on results using text instructions and multiple garment images. It addresses three overlooked problems: supporting multiple try‑on items, allowing dressing style specification via text, and eliminating reliance on segmentation models by using a parsing‑free garment encoder and a scalable data generation pipeline. Experiments on high‑resolution benchmarks and in‑the‑wild test sets show MMTryon outperforms state‑of‑the‑art methods qualitatively and quantitatively.

By Xujie Zhang, Ente Lin, Michael Kampffmeyer, Zhenyu Xie, Jiang Li, Ting Liu, Xiaochao Qu, Luoqi Liu, Xiaodan Liang
computer-visionmultimodalbenchmarks
More like this →
arXiv Computer Vision
Sep 3

FitControler: Toward Fit-Aware Virtual Try-On

FitControler introduces a fit-aware virtual try‑on system that adds garment fit control to existing VTON models. It uses a fit‑aware layout generator and a multi‑scale fit injector to redraw body‑garment layouts and render garments that match those layouts. The authors also release a new Fit4Men dataset of 13,000 body‑garment pairs and two fit consistency metrics to evaluate fit quality.

By Lu Yang, Yicheng Liu, Letian Zhou, Yanan Li, Xiang Bai, Hao Lu
More like this →