Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

E-CIR: Event-Enhanced Continuous Intensity Recovery

About

A camera begins to sense light the moment we press the shutter button. During the exposure interval, relative motion between the scene and the camera causes motion blur, a common undesirable visual artifact. This paper presents E-CIR, which converts a blurry image into a sharp video represented as a parametric function from time to intensity. E-CIR leverages events as an auxiliary input. We discuss how to exploit the temporal event structure to construct the parametric bases. We demonstrate how to train a deep learning model to predict the function coefficients. To improve the appearance consistency, we further introduce a refinement module to propagate visual features among consecutive frames. Compared to state-of-the-art event-enhanced deblurring approaches, E-CIR generates smoother and more realistic results. The implementation of E-CIR is available at https://github.com/chensong1995/E-CIR.

Chen Song, Qixing Huang, Chandrajit Bajaj• 2022

Related benchmarks

TaskDatasetResultRank
Motion DeblurringMVSEC Single frame prediction
PSNR27.792
11
Motion DeblurringDSEC-large Single frame prediction
PSNR21.46
11
Motion DeblurringMVSEC
PSNR26.773
10
Motion DeblurringStEIC
PSNR20.706
10
Motion DeblurringStEIC Single frame prediction
PSNR22.076
10
Motion DeblurringDSEC large
PSNR21.089
10
Video DeblurringREDS (val)
MSE0.114
4
Showing 7 of 7 rows

Other info

Code

Follow for update