Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Quadratic video interpolation

About

Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear models for interpolation, which cannot well approximate the complex motion in the real world. To address these issues, we propose a quadratic video interpolation method which exploits the acceleration information in videos. This method allows prediction with curvilinear trajectory and variable velocity, and generates more accurate interpolation results. For high-quality frame synthesis, we develop a flow reversal layer to estimate flow fields starting from the unknown target frame to the source frame. In addition, we present techniques for flow refinement. Extensive experiments demonstrate that our approach performs favorably against the existing linear models on a wide variety of video datasets.

Xiangyu Xu, Li Siyao, Wenxiu Sun, Qian Yin, Ming-Hsuan Yang• 2019

Related benchmarks

TaskDatasetResultRank
Video Frame InterpolationVimeo90K (test)
PSNR35.15
131
Video Frame InterpolationUCF101
PSNR32.89
117
Video Frame InterpolationDAVIS
PSNR27.17
33
Video Frame InterpolationVimeo-90K septuplet
PSNR35.15
20
Video Frame InterpolationSNU-FILM Hard
PSNR30.614
16
Video Frame InterpolationSNU-FILM Extreme
PSNR25.426
16
Video Frame InterpolationSNU-FILM Medium
PSNR34.637
16
Video Frame InterpolationBS-ERGB 3 skips
PSNR23.2
15
Video Frame InterpolationATD-12K Whole (test)
PSNR29.04
13
Video Frame InterpolationATD-12K RoI (test)
PSNR25.65
13
Showing 10 of 29 rows

Other info

Follow for update