Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TryOffAnyone: Tiled Cloth Generation from a Dressed Person

About

The fashion industry is increasingly leveraging computer vision and deep learning technologies to enhance online shopping experiences and operational efficiencies. In this paper, we address the challenge of generating high-fidelity tiled garment images essential for personalized recommendations, outfit composition, and virtual try-on systems from photos of garments worn by models. Inspired by the success of Latent Diffusion Models (LDMs) in image-to-image translation, we propose a novel approach utilizing a fine-tuned StableDiffusion model. Our method features a streamlined single-stage network design, which integrates garmentspecific masks to isolate and process target clothing items effectively. By simplifying the network architecture through selective training of transformer blocks and removing unnecessary crossattention layers, we significantly reduce computational complexity while achieving state-of-the-art performance on benchmark datasets like VITON-HD. Experimental results demonstrate the effectiveness of our approach in producing high-quality tiled garment images for both full-body and half-body inputs. Code and model are available at: https://github.com/ixarchakos/try-off-anyone

Ioannis Xarchakos, Theodoros Koukopoulos• 2024

Related benchmarks

TaskDatasetResultRank
Image Virtual Try-onVITON-HD
LPIPS35.26
14
Virtual Try-OffVITON-HD
SSIM75.9
5
Showing 2 of 2 rows

Other info

Follow for update