Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WarpI2I: Image Warping for Image-to-Image Translation

About

Image-to-image (I2I) translation has achieved strong results in tasks like human relighting and driving scene translation using latent diffusion models (LDMs). However, compact LDMs often struggle to preserve fine-grained structures because the encoder compresses high-resolution inputs into a spatially downsampled latent space. To address this issue, we propose a simple saliency-guided warp-unwarp framework that reallocates spatial representation toward salient regions before encoding, enabling better preservation of structural details without increasing latent resolution. The warped image is processed by the original diffusion model and then mapped back via an inverse warp. In addition, we propose a simple and efficient outpainting-based synthetic data generation pipeline to produce high-quality paired data for image relighting. Our method is model-agnostic, requires no architectural modification, and introduces negligible computational overhead. Experiments on human relighting, driving scene relighting, and translation demonstrate improved structural preservation, lighting faithfulness, and image quality, with our framework extending naturally to video via frame-by-frame application with good temporal stability. Project Webpage: https://shenzheng2000.github.io/WarpI2I.github.io

Shen Zheng, Anurag Ghosh, Gaurav Parmar, Srinivasa Narasimhan• 2026

Related benchmarks

TaskDatasetResultRank
Human RelightingVITON-HD
Person Identity4.36
5
Human RelightingStreetTryOn
Person Identity Score4.31
5
RelightingRelighting golden sunlight, noon sunlight, moonlight, and foggy conditions ChatGPT API evaluation (test)
Person Identity90.5
5
Human RelightingVITON (test)
Latency (s)0.898
5
Driving Scene RelightingROADWork Boston Golden Sunlight
Semantic Consistency4.53
4
Driving Scene RelightingROADWork Boston Foggy
Semantic Consistency4.48
4
Showing 6 of 6 rows

Other info

Follow for update