Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow

About

We introduce SEA-RAFT, a more simple, efficient, and accurate RAFT for optical flow. Compared with RAFT, SEA-RAFT is trained with a new loss (mixture of Laplace). It directly regresses an initial flow for faster convergence in iterative refinements and introduces rigid-motion pre-training to improve generalization. SEA-RAFT achieves state-of-the-art accuracy on the Spring benchmark with a 3.69 endpoint-error (EPE) and a 0.36 1-pixel outlier rate (1px), representing 22.9% and 17.8% error reduction from best published results. In addition, SEA-RAFT obtains the best cross-dataset generalization on KITTI and Spring. With its high efficiency, SEA-RAFT operates at least 2.3x faster than existing methods while maintaining competitive performance. The code is publicly available at https://github.com/princeton-vl/SEA-RAFT.

Yihan Wang, Lahav Lipson, Jia Deng• 2024

Related benchmarks

TaskDatasetResultRank
Optical Flow EstimationKITTI 2015 (train)
Fl-epe1.6
446
Optical Flow EstimationMPI Sintel Final (train)
Endpoint Error (EPE)3.74
215
Optical Flow EstimationMPI Sintel Clean (train)
EPE1.19
208
Optical FlowSintel (train)
AEPE (Clean)1.19
200
Optical Flow EstimationSintel Final (test)
EPE2.6
146
Optical FlowKITTI 2015 (test)
Fl Error (All)12.9
122
Optical Flow EstimationSintel clean (test)
EPE1.31
120
Optical Flow EstimationKITTI 2015 (test)
Fl-all4.3
117
Optical FlowSintel Final (train)
EPE0.782
112
Optical FlowSintel Clean (train)
EPE0.546
104
Showing 10 of 39 rows

Other info

Follow for update