Cross-Camera Convolutional Color Constancy
About
We present "Cross-Camera Convolutional Color Constancy" (C5), a learning-based method, trained on images from multiple cameras, that accurately estimates a scene's illuminant color from raw images captured by a new camera previously unseen during training. C5 is a hypernetwork-like extension of the convolutional color constancy (CCC) approach: C5 learns to generate the weights of a CCC model that is then evaluated on the input image, with the CCC weights dynamically adapted to different input content. Unlike prior cross-camera color constancy models, which are usually designed to be agnostic to the spectral properties of test-set images from unobserved cameras, C5 approaches this problem through the lens of transductive inference: additional unlabeled images are provided as input to the model at test time, which allows the model to calibrate itself to the spectral properties of the test-set camera during inference. C5 achieves state-of-the-art accuracy for cross-camera color constancy on several datasets, is fast to evaluate (~7 and ~90 ms per image on a GPU or CPU, respectively), and requires little memory (~2 MB), and thus is a practical solution to the problem of calibration-free automatic white balance for mobile photography.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Color Constancy | NCC (in-dataset) | Median Error5.56 | 29 | |
| Color Constancy | LEVI (in-dataset) | Median Error2.46 | 24 | |
| Color Constancy | NCC trained on LEVI (test) | Median Error4.47 | 10 | |
| Color Constancy | Gehler-Shi | Median Error3.34 | 7 | |
| Auto White Balance | NCC → LEVI | Median Error10.3 | 5 |