Cross-Camera Convolutional Color Constancy
About
We present "Cross-Camera Convolutional Color Constancy" (C5), a learning-based method, trained on images from multiple cameras, that accurately estimates a scene's illuminant color from raw images captured by a new camera previously unseen during training. C5 is a hypernetwork-like extension of the convolutional color constancy (CCC) approach: C5 learns to generate the weights of a CCC model that is then evaluated on the input image, with the CCC weights dynamically adapted to different input content. Unlike prior cross-camera color constancy models, which are usually designed to be agnostic to the spectral properties of test-set images from unobserved cameras, C5 approaches this problem through the lens of transductive inference: additional unlabeled images are provided as input to the model at test time, which allows the model to calibrate itself to the spectral properties of the test-set camera during inference. C5 achieves state-of-the-art accuracy for cross-camera color constancy on several datasets, is fast to evaluate (~7 and ~90 ms per image on a GPU or CPU, respectively), and requires little memory (~2 MB), and thus is a practical solution to the problem of calibration-free automatic white balance for mobile photography.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Color Constancy | NCC (in-dataset) | Median Error5.56 | 29 | |
| Color Constancy | LEVI (in-dataset) | Median Error2.46 | 24 | |
| Color Constancy | Gehler-Shi | Median Error1.61 | 22 | |
| Illuminant Estimation | NUS-8 (test) | Mean Error2.65 | 21 | |
| Illuminant Estimation | Gehler-Shi (test) | Mean Error3.34 | 21 | |
| Illuminant Estimation (Recovery) | ColorChecker REC (test) | Median Error1.4 | 20 | |
| Color Constancy | NUS-8 cross-sensor | Mean Error1.77 | 15 | |
| Color Constancy | Cube+ (test) | Mean Error1.87 | 13 | |
| Color Constancy | NUS-8 (test) | Mean Error2.54 | 12 | |
| Color Constancy | NCC trained on LEVI (test) | Median Error4.47 | 10 |