Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Deep Network Interpolation for Continuous Imagery Effect Transition

About

Deep convolutional neural network has demonstrated its capability of learning a deterministic mapping for the desired imagery effect. However, the large variety of user flavors motivates the possibility of continuous transition among different output effects. Unlike existing methods that require a specific design to achieve one particular transition (e.g., style transfer), we propose a simple yet universal approach to attain a smooth control of diverse imagery effects in many low-level vision tasks, including image restoration, image-to-image translation, and style transfer. Specifically, our method, namely Deep Network Interpolation (DNI), applies linear interpolation in the parameter space of two or more correlated networks. A smooth control of imagery effects can be achieved by tweaking the interpolation coefficients. In addition to DNI and its broad applications, we also investigate the mechanism of network interpolation from the perspective of learned filters.

Xintao Wang, Ke Yu, Chao Dong, Xiaoou Tang, Chen Change Loy• 2018

Related benchmarks

TaskDatasetResultRank
Super-ResolutionDIV2K--
155
Image DenoisingKodak 28 (test)
PSNR35.56
20
Image DenoisingCBSD68 35 (test)
PSNR34.55
20
Image Super-resolutionCBSD68
PSNR26.25
20
Image Super-resolutionKodak
PSNR27.25
20
phi regressionDay -> Timelapse (test)
Mean Error13.8
7
3D Shape GenerationDrivAerNet++ (Interpolation)
Chamfer Distance (CD)0.0118
4
3D Shape ExtrapolationIndustry-level cars Sports car (test)
MAE1.7
4
3D Shape ExtrapolationIndustry-level cars SUV (test)
MAE2.89
4
3D Shape ExtrapolationIndustry-level cars Convertible (test)
MAE3.42
4
Showing 10 of 15 rows

Other info

Follow for update