Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Neural Preset for Color Style Transfer

About

In this paper, we present a Neural Preset technique to address the limitations of existing color style transfer methods, including visual artifacts, vast memory requirement, and slow style switching speed. Our method is based on two core designs. First, we propose Deterministic Neural Color Mapping (DNCM) to consistently operate on each pixel via an image-adaptive color mapping matrix, avoiding artifacts and supporting high-resolution inputs with a small memory footprint. Second, we develop a two-stage pipeline by dividing the task into color normalization and stylization, which allows efficient style switching by extracting color styles as presets and reusing them on normalized input images. Due to the unavailability of pairwise datasets, we describe how to train Neural Preset via a self-supervised strategy. Various advantages of Neural Preset over existing methods are demonstrated through comprehensive evaluations. Notably, Neural Preset enables stable 4K color style transfer in real-time without artifacts. Besides, we show that our trained model can naturally support multiple applications without fine-tuning, including low-light image enhancement, underwater image correction, image dehazing, and image harmonization. Project page with demos: https://zhkkke.github.io/NeuralPreset .

Zhanghan Ke, Yuhao Liu, Lei Zhu, Nanxuan Zhao, Rynson W.H. Lau• 2023

Related benchmarks

TaskDatasetResultRank
Image HarmonizationiHarmony4
MSE24.31
27
Image Color Style TransferLuan et al. (test)
CPU Inference Time (s)0.215
15
Photorealistic Preset TransferRealistic Dataset (test)
GPT-4o Score2.7667
9
Photorealistic Preset TransferSynthetic dataset
PSNR22.16
9
Color Style Transfer20 image sets (val)
Average Ranking1.81
7
Color Style TransferFHD 1920 x 1080
Inference Time (s)0.013
6
Image Color EnhancementMIT-Adobe FiveK (test)
PSNR23.12
6
Image Preset Filter TransferPST50 (unpaired)
GPT-4o Score2.76
6
Preset TransferPST50 paired
PSNR19.25
6
Color Style Transfer2K 2560 x 1440
Inference Time0.016
5
Showing 10 of 12 rows

Other info

Code

Follow for update