Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Domain-adaptive Video Deblurring via Test-time Blurring

About

Dynamic scene video deblurring aims to remove undesirable blurry artifacts captured during the exposure process. Although previous video deblurring methods have achieved impressive results, they suffer from significant performance drops due to the domain gap between training and testing videos, especially for those captured in real-world scenarios. To address this issue, we propose a domain adaptation scheme based on a blurring model to achieve test-time fine-tuning for deblurring models in unseen domains. Since blurred and sharp pairs are unavailable for fine-tuning during inference, our scheme can generate domain-adaptive training pairs to calibrate a deblurring model for the target domain. First, a Relative Sharpness Detection Module is proposed to identify relatively sharp regions from the blurry input images and regard them as pseudo-sharp images. Next, we utilize a blurring model to produce blurred images based on the pseudo-sharp images extracted during testing. To synthesize blurred images in compliance with the target data distribution, we propose a Domain-adaptive Blur Condition Generation Module to create domain-specific blur conditions for the blurring model. Finally, the generated pseudo-sharp and blurred pairs are used to fine-tune a deblurring model for better performance. Extensive experimental results demonstrate that our approach can significantly improve state-of-the-art video deblurring methods, providing performance gains of up to 7.54dB on various real-world video deblurring datasets. The source code is available at https://github.com/Jin-Ting-He/DADeblur.

Jin-Ting He, Fu-Jen Tsai, Jia-Hao Wu, Yan-Tsung Peng, Chung-Chi Tsai, Chia-Wen Lin, Yen-Yu Lin• 2024

Related benchmarks

TaskDatasetResultRank
Video DeblurringBSD (1ms-8ms)
PSNR29.44
19
Video DeblurringBSD 2ms-16ms
PSNR28.36
19
Video DeblurringBSD 3ms-24ms
PSNR28.23
19
Video DeblurringHVD-Huawei
MUSIQ Score26.8422
10
Video DeblurringHVD-Xiaomi
MUSIQ Score32.3833
10
Video DeblurringHVD iPhone
MUSIQ Score25.3244
10
Video DeblurringGoProShake
PSNR29.54
10
Video DeblurringGoProShake (test)
tOF2.068
6
Video DeblurringRealBlur
PSNR27.41
4
Video DeblurringRBVD
PSNR27.02
4
Showing 10 of 10 rows

Other info

Follow for update