Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Stripformer: Strip Transformer for Fast Image Deblurring

About

Images taken in dynamic scenes may contain unwanted motion blur, which significantly degrades visual quality. Such blur causes short- and long-range region-specific smoothing artifacts that are often directional and non-uniform, which is difficult to be removed. Inspired by the current success of transformers on computer vision and image processing tasks, we develop, Stripformer, a transformer-based architecture that constructs intra- and inter-strip tokens to reweight image features in the horizontal and vertical directions to catch blurred patterns with different orientations. It stacks interlaced intra-strip and inter-strip attention layers to reveal blur magnitudes. In addition to detecting region-specific blurred patterns of various orientations and magnitudes, Stripformer is also a token-efficient and parameter-efficient transformer model, demanding much less memory usage and computation cost than the vanilla transformer but works better without relying on tremendous training data. Experimental results show that Stripformer performs favorably against state-of-the-art models in dynamic scene deblurring.

Fu-Jen Tsai, Yan-Tsung Peng, Yen-Yu Lin, Chung-Chi Tsai, Chia-Wen Lin• 2022

Related benchmarks

TaskDatasetResultRank
Image DeblurringGoPro (test)
PSNR34.678
672
Image DeblurringGoPro
PSNR33.08
414
Image DeblurringRealBlur-J (test)
PSNR32.48
259
Image DeblurringHIDE (test)
PSNR31.03
242
DeblurringRealBlur-R (test)
PSNR39.84
170
DeblurringRealBlur-R
PSNR39.84
87
DeblurringRealBlur-J
PSNR32.48
84
Image DeblurringHIDE
PSNR30.91
56
Single-image motion deblurringGoPro
PSNR33.08
44
Image DeblurringUHD-Blur
PSNR25.052
37
Showing 10 of 33 rows

Other info

Code

Follow for update