Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow

About

We introduce SEA-RAFT, a more simple, efficient, and accurate RAFT for optical flow. Compared with RAFT, SEA-RAFT is trained with a new loss (mixture of Laplace). It directly regresses an initial flow for faster convergence in iterative refinements and introduces rigid-motion pre-training to improve generalization. SEA-RAFT achieves state-of-the-art accuracy on the Spring benchmark with a 3.69 endpoint-error (EPE) and a 0.36 1-pixel outlier rate (1px), representing 22.9% and 17.8% error reduction from best published results. In addition, SEA-RAFT obtains the best cross-dataset generalization on KITTI and Spring. With its high efficiency, SEA-RAFT operates at least 2.3x faster than existing methods while maintaining competitive performance. The code is publicly available at https://github.com/princeton-vl/SEA-RAFT.

Yihan Wang, Lahav Lipson, Jia Deng• 2024

Related benchmarks

TaskDatasetResultRank
Optical Flow EstimationKITTI 2015 (train)
Fl-epe1.6
446
Optical Flow EstimationMPI Sintel Final (train)
Endpoint Error (EPE)3.74
209
Optical Flow EstimationMPI Sintel Clean (train)
EPE1.19
202
Optical FlowSintel (train)
AEPE (Clean)1.19
200
Optical Flow EstimationSintel Final (test)
EPE2.6
133
Optical Flow EstimationSintel clean (test)
EPE1.31
120
Optical Flow EstimationKITTI 2015 (test)
Fl-all4.3
108
Optical FlowKITTI-15 (test)
Fl-all4.3
85
Optical FlowKITTI (train)
Fl-all0.129
84
Optical Flow EstimationKITTI 2015
Fl-all4.3
60
Showing 10 of 29 rows

Other info

Follow for update