Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow

About

We introduce SEA-RAFT, a more simple, efficient, and accurate RAFT for optical flow. Compared with RAFT, SEA-RAFT is trained with a new loss (mixture of Laplace). It directly regresses an initial flow for faster convergence in iterative refinements and introduces rigid-motion pre-training to improve generalization. SEA-RAFT achieves state-of-the-art accuracy on the Spring benchmark with a 3.69 endpoint-error (EPE) and a 0.36 1-pixel outlier rate (1px), representing 22.9% and 17.8% error reduction from best published results. In addition, SEA-RAFT obtains the best cross-dataset generalization on KITTI and Spring. With its high efficiency, SEA-RAFT operates at least 2.3x faster than existing methods while maintaining competitive performance. The code is publicly available at https://github.com/princeton-vl/SEA-RAFT.

Yihan Wang, Lahav Lipson, Jia Deng• 2024

Related benchmarks

TaskDatasetResultRank
Optical Flow EstimationKITTI 2015 (train)
Fl-epe1.6
431
Optical Flow EstimationMPI Sintel Final (train)
Endpoint Error (EPE)3.74
209
Optical Flow EstimationMPI Sintel Clean (train)
EPE1.19
202
Optical FlowSintel (train)
AEPE (Clean)1.19
179
Optical FlowKITTI-15 (test)
Fl-all4.3
85
Optical FlowMPI Sintel (test)
EPE (Final)1.96
27
Optical FlowSintel Clean
EPE1.309
27
Optical FlowSintel Final
EPE2.601
27
Optical FlowSpring (test)
EPE0.363
18
Optical FlowSRFlow (test)
EPE0.5314
18
Showing 10 of 12 rows

Other info

Follow for update