Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing

About

We propose a flexible person generation framework called Dressing in Order (DiOr), which supports 2D pose transfer, virtual try-on, and several fashion editing tasks. The key to DiOr is a novel recurrent generation pipeline to sequentially put garments on a person, so that trying on the same garments in different orders will result in different looks. Our system can produce dressing effects not achievable by existing work, including different interactions of garments (e.g., wearing a top tucked into the bottom or over it), as well as layering of multiple garments of the same type (e.g., jacket over shirt over t-shirt). DiOr explicitly encodes the shape and texture of each garment, enabling these elements to be edited separately. Joint training on pose transfer and inpainting helps with detail preservation and coherence of generated garments. Extensive evaluations show that DiOr outperforms other recent methods like ADGAN in terms of output quality, and handles a wide range of editing functions for which there is no direct supervision.

Aiyu Cui, Daniel McKee, Svetlana Lazebnik• 2021

Related benchmarks

TaskDatasetResultRank
Pose TransferDeepFashion (test)
User Preference Score57.48
9
Pose TransferDeepFashion 256x256 (test)
FID12.97
7
Garment TransferDance50k (test)
SSIM88.4
4
Garment TransferDeepFashion (test)
SSIM72.8
4
Pose TransferDeepFashion 256x176 (test)
SSIM0.806
3
Virtual Try-OnDeepFashion (test)
User Preference Score80.64
2
Showing 6 of 6 rows

Other info

Code

Follow for update