Deep Network Interpolation for Continuous Imagery Effect Transition
About
Deep convolutional neural network has demonstrated its capability of learning a deterministic mapping for the desired imagery effect. However, the large variety of user flavors motivates the possibility of continuous transition among different output effects. Unlike existing methods that require a specific design to achieve one particular transition (e.g., style transfer), we propose a simple yet universal approach to attain a smooth control of diverse imagery effects in many low-level vision tasks, including image restoration, image-to-image translation, and style transfer. Specifically, our method, namely Deep Network Interpolation (DNI), applies linear interpolation in the parameter space of two or more correlated networks. A smooth control of imagery effects can be achieved by tweaking the interpolation coefficients. In addition to DNI and its broad applications, we also investigate the mechanism of network interpolation from the perspective of learned filters.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Super-Resolution | DIV2K | -- | 155 | |
| Image Denoising | Kodak 28 (test) | PSNR35.56 | 20 | |
| Image Denoising | CBSD68 35 (test) | PSNR34.55 | 20 | |
| Image Super-resolution | CBSD68 | PSNR26.25 | 20 | |
| Image Super-resolution | Kodak | PSNR27.25 | 20 | |
| phi regression | Day -> Timelapse (test) | Mean Error13.8 | 7 | |
| 3D Shape Generation | DrivAerNet++ (Interpolation) | Chamfer Distance (CD)0.0118 | 4 | |
| 3D Shape Extrapolation | Industry-level cars Sports car (test) | MAE1.7 | 4 | |
| 3D Shape Extrapolation | Industry-level cars SUV (test) | MAE2.89 | 4 | |
| 3D Shape Extrapolation | Industry-level cars Convertible (test) | MAE3.42 | 4 |