Efficient tensor completion for color image and video recovery: Low-rank tensor train
About
This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks to its definition from a well-balanced matricization scheme. Accordingly, new optimization formulations for tensor completion are proposed as well as two new algorithms for their solution. The first one called simple low-rank tensor completion via tensor train (SiLRTC-TT) is intimately related to minimizing a nuclear norm based on TT rank. The second one is from a multilinear matrix factorization model to approximate the TT rank of a tensor, and is called tensor completion by parallel matrix factorization via tensor train (TMac-TT). A tensor augmentation scheme of transforming a low-order tensor to higher-orders is also proposed to enhance the effectiveness of SiLRTC-TT and TMac-TT. Simulation results for color image and video recovery show the clear advantage of our method over all other methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Light field data completion | Greek 128x128x3x30 | PSNR33.15 | 70 | |
| Realistic color video completion | News 144×176×3×30 | PSNR34.67 | 70 | |
| Realistic color video completion | Grandma 144×176×3×30 | PSNR38.39 | 70 | |
| Realistic color video completion | Akiyo 144×176×3×30 | PSNR37.7 | 70 | |
| Realistic color video completion | Claire 144×176×3×30 | PSNR37.21 | 70 | |
| Light field data completion | Museum 128x128x3x30 | PSNR36.12 | 70 | |
| Light field data completion | Vinyl 128x128x3x30 | PSNR36.29 | 70 | |
| Light field data completion | Medieval2 128x128x3x30 | PSNR35.48 | 70 | |
| MSI Completion | Feathers 256x256x31 (test) | PSNR38.01 | 35 | |
| MSI Completion | Flowers 256x256x31 (test) | PSNR36.93 | 35 |